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(54) Video dance game apparatus 

(57) A video dance game apparatus for displaying 
an image of at least two dancers on a screen and con- 
trolling the dancers to play various dance performances 
in accordance with an external operation to thereby 
offer a dance game, is provided with: an image display- 
ing device (10, 11, *12) for displaying the image of the 
dancers: a dance music output device (4. 5) for ouiput- 
ting a music signal indicating a dance music; a beat 
information generating device (1) for generating beat 
information on the basis of the music signal; a dance 
performance data selecting and reading out device (1) 
for selecting and reading out one of the dance perform- 
ance data pieces stored in a'dance performance data 
memory device: an image control device (7. 8, 9) for 
controlling the image displaying device to change the 
image of the dancers such that the dancers play a 
dance performance corresponding to the read out 
dance performance data piece; an operation device (6) 
by which the externa! operation is inputted, for operating 
the dance performance data selecting and reading out 
device in accordance with the external operation to 
select and read out the one of the dance performance 
data pieces; and a score calculating device (1) for calcu- 
lating a game score on the basis of a time lag between 
a read-out timing of the dance performance data piece 
and a generation timing of the beat iriformation. 



FIG.l 



TV 



PROGRAM/DAT> 
ROM 



o 



o 



o 



GAVE SCUtO 
SOURCE 



OPERATXM 
SECTION 



O 



POLYGON 
PARAMETHR 



PQLYGC3N DATA 
fcEMORY 



COORDHATES 
CQTA/ERaCN 
PR0CESSN5 



FRA\C kEMORY 



C 



POLYGON 
PANT 

DEVKZ 



/t2 



DISPLAY 



PrifTiad by Xerox (Ul^ Business Services 
2.15.8/3.4 



BNSOOCID: <EP. 



,0823270A2_I_> 



EP 0 823 270 A2 

Description 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

The present invention relates to a video dance game apparatus, which displays at least two dancers on a screen 
and controls the dancers to play various performances on the screen by an external operation or drive to thereby allow 
a dance game, and also relates to a program storage device readable by the apparatus. 

10 

Z. Description of the Related Art 

There is a fighting game apparatus as one kind of a television game apparatus, in which two characters (i.e. two 
persons or fighters) are displayed on a screen. This is Intended to control one character to play a performance by an 
13 externa! operation or drive to thereby defeat the other character. That is. two game players compete with each other or 
one game player competes with a computer by inflicting a damage to the competitor's character or defending ones own 
character from the competitor's character by a timing of playing the performance and a selection of the kind of the per- 
formance. 

However, in such a conventional game apparatus, the timing of playing the performance may be a timing when an 
20 effective damage can be inflicted on the competitor's character In other words, there is no game apparatus which 
involves competing for superiority or. inferiority of sense of rhythm, such as moving a character on the screen in harmo- 
nization with or in time to a constant musical rhythm. 

Moreover, in not only the fighting game but also most of the conventional game apparatuses, one game player com- 
petes against the other game player or the computer as for the operating or driving skill. There is no game of competing 
25 for the cooperation or harmonization between two game players. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide a video game apparatus in a perfectly new field for com- 

30 peting for a high score by letting at least two dancers on the screen play a dance cooperatively 

The above object of the present invention can be achieved by a first video dance game apparatus for displaying an 
image of at least two dancers on a screen and controlling the dancers in the displayed image to play various dance per- 
formances in accordance with an external operation by a game player to thereby offer a dance game to the game player. 
The first video dance game apparatus is provided with: an image displaying device having the screen, for displaying the 

35 image of the dancers on the screen; a dance music output device for outputting a music signal indicating a dance music; 
a beat information generating device for generating beat information on the basis of the music signal; a dance perform- 
ance data memory device for storing a plurality of dance performance data pieces each indicating respective one of the 
various dance performances; a dance performance data selecting and reading out device for selecting and reading out 
• one of the dance performance data pieces stored in the dance performance data memory device; an image control 

40 device for controlling the image displaying device to change the image of the dancers such that the dancers play a 
dance performance corresponding to the read out dance performance data piece; an operation device by which the 
external operation is inputted, for operating the dance performance data selecting and reading out device in accordance 
with the external operation to select and read out the one of the dance performance data pieces, so as to change the 
dance performance of the dancers on the screen; and a score calculating device for calculating a game score on the 

45 basis of a time lag between a read-out timing, which is a timing at which the dance performance data piece is read out 
by the dance performance data selecting and reading out device in accordance with the external operation, and a gen- 
eration timing of the beat information, which is a timing at which the beat information Is generated by the beat informa- 
tion generating device. 

According to the first video dance game apparatus, the image of at least two dancers is displayed on the screen by 
50 the image display device, while a music signal indicating a dance music is outputted by the dance music output device. 
In this condition, the game player operates the operation device, such as button switches, drive levers, a keyboard, a 
mouse, a joy-stick or the like, and inputs the external operation by the operation device in accordance with this dance 
rriusic. Then, the dance performance data selecting and reading out device is operated, so that one of the dance per- 
formance data pieces stored in the dance performance data memory device is selected and read out by the dance per- 
55 formance data selecting and reading out device. Thus, under the control of the image control device, the image of the 
dancers is changed by the image displaying device such that the dancers play a dance performance corresponding to 
the read out dance performance data piece. Namely, the dance performance of one of the dancers in the displayed 
image is changed in correspondence with the read dance performance data piece. At this time, the dance performance 
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of another of the dancers in the displayed image is also changed in the similar manner when another game player oper- 
ates the operation device, in this way. while at least two dancers play dance on the screen, the time lag between the 
read-out timing in accordance with the external operation by the operation device, and the generation timing of the beat 
information generated by the beat information generating device on the basis of the music signal, is detected by the 

5 score calculating device, and the game score is calculated by the score calculating device on the basis of this detected 
time lag. Therefore, the game score becomes the higher as the timing at which the game player changes the dance per- 
formance by way of the operation device gets the closer to the timing of the beat of the dance music. 

The above object of the present Invention can be also achieved by a second video dance game apparatus for dis- 
playing an image of at least two dancers on a screen and controlling the dancers in the displayed image to play various 

10 dance performances in accordance with an external operation by a game player to thereby offer a dance game to the 
game player. The second video dance game apparatus is provided with: an image displaying device having the screen, 
for displaying the image of the dancers on the screen; a dance music output device for outputting a music signal indi- 
cating a dance music; a beat information generating device for generating beat information on the basis of the music 
signal; a dance performance data memory device for storing a plurality of dance performance data pieces each indicat- 

15 ing respective one of the various dance performances; a dance performance data selecting and reading out device for 
selecting and reading out one of the dance performance data pieces stored in the dance performance data mennory 
device; an image control device for controlling the image displaying device to change the image of the dancers such 
that the dancers play a dance performance corresponding to the read out dance performance data piece; an operation 
device by which the external operation is inputted, for operating the dance performance data selecting and reading out 

SG device in accordance with the external operation to select and read out the one of the dance performance data pieces 
^ for at least one of the dancers, so as to change the dance performance of the at least one of the dancers on the screen; 
a read-out control device for controlling the dance performance data selecting and reading out device to select and read 
out another of the dance performance data pieces for another of the dancers in a predetermined order and at a prede- 
termined timing which are set in advance for the another of the dancers; and a score calculating device for calculating 

25 a game score on the basis of a time lag between a read-out timing, which is a timing at which the dance performance 
data piece is read out by the dance performance data selecting and reading out device in accordance with the external 
operation, and a generation timing of the beat information, which is aiming at which the beat information is generated 
by the beat information generating device. 

According to the second video dance game apparatus, the image of at least two dancers is displayed on the screen 

30 by the image display device, while a music signal indicating a dance music is outputted by the dance music output 
device. In this condition, the game player operates the operation device, and inputs the external operation by the oper- 
ation device in accordance with this dance music. Then, the dance performance data selecting and reading out device 
is operated, so that one of the dance performance data pieces stored in the dance performance data memory device is 
selected and read out by the dance performance data selecting and reading out device. Thus, under the control of the 

35 image control device, the dance performance of one of the dancers in the displayed image is changed in correspond- 
ence with the read dance performance data piece. On the other hand, when, under the control of the read-out control 
device, another of the dance performance data pieces for another of the dancers in the predetermined order and at the 
predetermined timing is selected and read out by the dance performance data selecting and reading out device, the 
dance performance of another of the dancers in the displayed image is also changed. In this way. while at least two 

40 dancers play dance on the screen, the time lag between the read-out timing in accordance with the external operation 
by the operation device, and the generation timing of the beat information generated by the beat information generating 
device on the basis of the music signal, is detected by the score calculating device, and the game score is calculated 
by the score calculating device on the basis of this detected time lag. Therefore, the game score becomes the higher 
as the timing at which the game player changes the dance performance by way of the operation device gets the closer 

45 .to the timing of the beat of the dance music. 

According to the above described first or second video dance game apparatus, while the game player can experi- 
ence a virtual dance, the game player can compete for the musical sense and the artistic sense. 

The above object of the present invention can be also achieved by a third video dance game apparatus for display- 
ing an image of at least two dancers on a screen and controlling the dancers in the displayed image to play various 

so dance performances in accordance with an external operation by a game player to thereby offer a dance game to the 
game player. The third video dance game apparatus is provided with: an image displaying device having the screen, for 
displaying the image of the dancers on trte screen; a dance music output device for outputting a music signal indicating 
a dance music; a beat information generating device for generating beat information on the basis of the music signal; a 
dance performance data memory device for storing a plurality of dance performance data pieces each indicating 

55 respective one of the various dance performances: a dance performance data selecting and reading out device for 
selecting and reading out one of the dance performance data pieces stored in the dance performance data memory 
device; an image control device for controlling the image displaying device to change the image of the dancers such 
that the dancers play a dance performance corresporKling to the read out dance performance data piece: an operation 
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device by which the external operation is inputted, for operating the dance perfornnance data selecting and reading out 
device in accordance with the external operation to select and read out the one of the dance performance data pieces, 
so as to change the dance performance of the dancers on the screen; a judging device for judging a mutual relation 
between the dancers in the displayed image: a dance performance data selection permitting device for permitting the 

5 dance performance data selecting and reading out device to select the one of the dance pedormance data pieces only 
from among the dance perforrhance data pieces each indicating such a dance performance that movements of the 
dancers are interlocked with each other, in case that the judged mutual relation is a predetermined relation; and a score 
calculating device for calculating a game score on the basis of the read out dance performance data piece in corre- 
spondence with the external operation. 

7a According to the third video dance game apparatus, the image of at least two dancers is displayed on the screen 
by the image display device, while a music signal indicating a dance music is^butputted by the dance music output 
device. In this condition, the game player operates the operation device, such as button switches, drive levers, a key- 
board, a mouse, a joy-stick or the like, and inputs the external operation by the operation device in accordance with this 
dance music. Then, the dance performance data selecting and reading out device is operated, so that one of the dance 

15 performance data pieces stored in the dance performance data memory device is selected and read out by the dance 
performance data selecting and reading out device. Thus, under the control of the image control device, the dance per- 
formance of one of the dancers in the displayed image is changed in correspondence with the read dance performance 
data piece. At this time, the dance performance of another of the dancers in the displayed image is also changed in the 
similar manner when another game player operates the operation device. In this way. while at least two dancers play 

20 - dance on the screen, a mutual relation between the dancers in the displayed image is judged by the judging device. In 
case that the judged mutual relation is a predetermined relation, the dance performance data selecting and reading out 
device is permitted to select the one of the dance performance data pieces only from among the dance performance 
data pieces each indicating such a dance performance that movements of the dancers are interlocked with each other, 
by the dance performance data selection permitting device. Then, the game score is calculated by the score calculating 

25 device on the basis of the read out dance performance data piece, which is read out by this permitted dance perform- 
ance data selecting and reading out device, in correspondence with the external operation. Therefore, the game score 
becomes the higher as the timing at which the game player changes a combined or pair dance performance for exam- 
ple, by way of the operation device while at least two dancers in the displayed image perform the combined or pair 
dance performance, gets the closer to the timing of the beat of the dance music. 

30 The above object of the present invention can be also achieved by a fourth video dance game apparatus for dis- 
playing an image of at least two dancers on a screen and controlling the dancers in the displayed image to play various 
dance performances in*accordance with an external operation by a game player to thereby offer a dance game to the 
game player. The fourth video dance game apparatus is provided with: an image displaying device having the screen, 
for displaying the image of the dancers on the screen; a dance music output device for outputting a music signal indi- 

35 eating a dance music; a beat information generating device for generating beat information on the basis of the music 
signal; a dance performance data memory device for storing a plurality of dance performance data pieces each indicat- 
ing respective one of the various dance performances; a dance performance data selecting and reading out device for 
selecting and reading out one of the dance performance data pieces stored in the dance performance data memory 
device; an image control dsvice for controlling the image displaying device to change the image of the dancers such 

40 that the dancers play a dance performance corresponding to the read out dance performance data piece; an operation 
device by which the external operation is inputted, for operating the dance performance data selecting and reading out 
device in accordance with the external operation to select and read out the one of the dance performance data pieces 
for at least one of the dancers, so as to change the dance performance of the at least one of the dancers on the screen; 
a read-out control device for controlling the dance performance data selecting and reading out device to select and read 

45 out another of the dance performance data pieces for another of the dancers in a predetermined order and at a prede- 
termined timing which are set in advance for the another of the dancers; a judging device for judging a mutual relation 
between the dancers in the displayed image; a dance performance data selection permitting device for permitting the 
dance performance data selecting and reading out device to select the one of the dance performance data pieces only 
from among the dance performance data pieces each indicating such a dance performance that movements of the 

so dancers are interlocked with each other, in case that the judged mutual relation is a predetermined relation; and a score 
calculating device for calculating a game score on the basis of the read out dance performance data piece in corre- 
^spo ndence with the external operation. 

According to the fourth video dance game apparatus, the image of at least two dancers is displayed on the screen 
by the image display device, while a music- signal indicating a dance music is outputted by the dance music output 

55 device. In this condition, the game player operates the operation device, such as button switches, drive levers, a key- 
board; a mouse, a joy-stick or the like, and inputs the external operation by the operation device in accordance with this 
dance music. Then, the dance performance data selecting and reading out device is operated, so that one of the dance 
performance data pieces stored in the dance performance data memory device is selected and read out by the dance 
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performance data selecting and reading out device. Thus, under the control of the image control device, the dance per- 
formance of one of the dancers in the displayed image is changed in correspondence with the read dance performance 
data piece. On the other hand. when, under the control of the read-out control device, another of the dance performance 
data pieces for another of the dancers in the predetermined order and at the predetermined timing is selected and read 

5 out by the dance performance data selecting and reading out device, the dance performance of another of the dancers 
in the displayed image is also changed. In this way. while at least two dancers play dance on the screen, a mutual rela- 
tion between the dancers in the displayed image is judged by the judging device. In case that the judged mutual relation 
is a predetermined relation, the dance performance data selecting and reading out device is permitted to select the one 
of the dance performance data pieces only from among the dance performance data pieces each indicating such a 

to dance performance that movements of the dancers are interlocked with each other, by the dance performance data 
selection permitting device. Then, the game score is calculated by the score calculating device on the basis of the read 
out dance performance data piece, which is read out by this permitted dance performance data selecting and reading 
out device, in correspondence with the external operation. 

According to the above described third or fourth video dance game apparatus, the game player can operate at least 

IS two dancers in the displayed image to play a combined or pair dance performance, and can enjoy a more realistic dance 
competition. 

In one aspect of each of the first to fourth video dance game apparatuses of the present invention, the apparatus 
is further provided with: a time measuring device for measuring time and restricting a time period, during which the 
external operation is inputted by the operation device, to a predetermined time period; and a time adjusting device for 
20 adjusting the predetermined time period on the basis of the game score calculated by the score calculating device. 

According to this aspect, the time period, during which the external operation is inputted by the operation device 
' (i.e. the game time period) is restricted to a predetermined time period by the time measuring device. Since this prede- 
termined time period is adjusted by the time adjusting de/ice on the basis of the game score calculated by the score 
calculating device, as the game player gets the higher score, the longer game time period is given to the game player. 
25 for example. Accordingly, the game player can enjoy the longer game time period, and the point may be further added 
to the game score in such a case. 

In another aspect of the first or second video dance game apparatus of the present invention, the score calculating 
device calculates the game score on the basis of at least one of a selection order of the dance performance data pieces 
in correspondence with the external operation, a mutual relation between the successively read dance performance 
30 data pieces, and a continuity between the successively read dance performance data pieces, in addition to the time lag- 
According to this aspect, since the game score is calculated by the score calculating device on the basis of at least 
one of the selection'order. the mutual relation and the continuity in addition to the time. lag. the musical sense and/or 
the artistic sense as for the dance can be reflected onto the video dance game. Accordingly, the enjoyment of the video 
dance game can be promoted. 

35 In this aspect, the apparatus may be further provided with: a basic movement data memory device for storing a plu- 

ralrty of basic movement data pieces to change the image in various manners respectively such that the dancers per- 
form a predetermined movement in accordance with the outputted dance music when the image of the dancers is not 
changed in correspondence with the read dance performance data piece; a basic movement level setting device for set- 
ting a basic movement level on the basis of at least one of the read-out timing, the selection order, the mutual relation 

40 and the continuity between the successively read dance performance data pieces; a basic movement data selecting 
and reading out device for selecting and reading out one of the.basic movement data pieces in accordance with the 
basic movement level set by the base movement level setting device: and a basic movement control device for control- 
ling the image displaying device to change the Image of the dancers such that the dancers perform the predetermined 
movement corresponding to the read out basic movement data piece, when the image of the dancers is not changed in 

45 .correspondence with the read dance performance data piece. 

In this case, when the dance performance data piece is read out, the basic movement level is set by the basic 
movement level setting device on the basis of at least one of the read-out timing, the selection order, the mutual relation 
and the continuity. Then, one of the basic movement data pieces stored in the basic movement data memory device is 
selected and read out by the basic movement data selecting and reading out device, in accordance with the basic 

£0 movement level set by the basic movement level setting device. When the image of the dancers is not changed in cor- 
respondence with the read dance performance data piece, under the control of the basic movement control device, the 
image of the dancers is changed by the lmage displaying device such that the dancers perform the predetermined 
movement corresponding to the read out basic movement data piece. Therefore, even when the external operation is 
not inputted by the operation device, the image of the dancers Is changed so as to perform the predetermined move- 

55 ment Thus, the dance performance can be played in a manner similar to the real dance actions, and the musical sense 
and/or the artistic sense as for the dance can be reflected onto the predetermined movement of the dancers. 

In this aspect also, the apparatus may be further provided with a dance music control device for controlling the 
dance music output device to change the music signal outputted therefrom in accordance with at least one of the read- 
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out timing, the selection order, the mutual relation and the continuity between the successively read dance performance 
data pieces. 

In this case, under the control of the dance music control device, the music signal outputted from the dance music 
output device is changed in accordance with at least one of the read-out timing, the selection order, the mutual relation 

5 and the continuity. Therefore, in case of the dance performance having a high musical sense or a high artistic sense as 
for the dance, if the external operation to play the dance performance excellent in the cooperation between the dancers 
is inputted by the game player, the dance music excited correspondingly can be outputted. so that the cooperative feel- 
ing between the dance and the music can be improved. 

In another aspect of the third or fourth video dance game apparatus of the present invention, the judging device 

10 judges a mutual positional relation between the dancers in the displayed image, as the mutual relation. And that, the 
score calculating device calculates the game score on the basis of at least one of a read-out timing, which is a timing 
at which the dance p^erformance data piece is read out by the dance performance data selecting and reading out device, 
the mutual positional relation, a selection order of the dance performance data pieces, a mutual relation between the 
successively read dance performance data pieces, and a continuity between the successively read dance performance 

15 data pieces, in correspondence with the external operation. 

According to this aspect, the mutual positional relation between the dancers in the displayed image is judged as the 
mutual relation by the judging device. Then, the game score is calculated by the score calculating device on the basis 
of at least one of the read-out timing, the mutual positional relation, the selection order, the mutual relation and the con- 
tinuity, in correspondence with the external operation. Therefore, not only the musical sense and/or the artistic sense 

20 as for the dance but also the cooperative sense can be even more reflected onto the video dance game. 

. In this aspect, the apparatus may be further provided with: a basic movement data memory device for storing a plu- 
rality of basic movement data pieces to change the image in various manners respectively such that the dancers per- 
form a predetermined movement in accordance with the outputted dance music when the image of the dancers is not 
changed in correspondence with the read dance performance data piece; a basic movement level setting device for set- 

23 ting a basic movement level on the basis of at least one of the read-out timing, the mutual positional relation, the selec- 
tion order, the mutual relation and the continuity between the successively read dance performance data pieces: a 
basic movement data selecting and reading out device for selecting and reading out one of the basic movement data 
pieces in accordance with the basic movement level set by the basic movement level setting device; and a basic move- 
ment control device for controlling the Image displaying device to change the image of the dancers such that the danc- 

30 ers perform the predetermined movement con-esponding to the read out basic movement data piece, when the image 
of the dancers is not changed in correspondence with the read dance performance data piece. 

■ In this case, whenihe dance performance data piece is read out, the basic movement level is set by the basic 
movement level setting device on the basis of at least one of the read-out timing, the mutual positional relation, the 
selection order, the mutual relation and the continuity. Then, one of the basic movement data pieces stored in the basic 

33 movement data memory device is selected and read out by the basic movement data selecting and reading out device, 
in accordance with the basic movement level set by the basic movement level setting device. When the image of the 
dancers is not changed in correspondence with the read dance performance data piece, under the control of the basic 
movement control device, the image of the dancers is changed by the image displaying device such that the dancers 
perform the predetermined movement corresponding to the read out basic movement data piece. Therefore, even when 

40 the external operation is not inputted by the operation device, the image of the dancers is changed so as to perform the 
predetermined movement. Thus, the dance performance can be played in a manner similar to the real dance actions, 
and the musical sense and/or the artistic sense as for the dance can be reflected onto the predetermined movement of 
the dancers. 

In this aspect also, the apparatus may be further provided with a dance music control device for controlling the 
45 dance music output device to change the music signal outputted therefrom in accordance with at least one of the read- 
out timing, the mutual positional relation, the selection order, the mutual relation and the continuity between the succes- 
sively read dance performance data pieces. 

In this case, under the control of the dance music control device, the music signal outputted from the dance music 
output device is changed in accordance with at least one of the read-out timing, the mutual positional relation, the selec- 
50 tion order, the mutual relation and the continuity. Therefore, in case of the dance performance having a high musical 
sense or a high artistic sense as for the dance, if the external djDeration to play the dance performance excellent in the 
cooperation between the dancers is inputted "by the game player, the dance music excited correspondingly can be out- 
putted. so that the cooperative feeling between the dance and the music can be improved. 

In another aspect of the first or second video dance game apparatus of the present invention, the apparatus is fur- 
55 ther provided with a dance music control device for controlling the dance music output device to change the music sig- 
nal outputted therefrom in accordance with the read-out timing and the generation timing. 

According to this aspect, under the control of the dance music control device, the music signal outputted from the 
dance music output device is changed in accordance with the read-out timing and the generation timing. Therefore, in 
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case that the external operation to obtain a high game score is inputted by the game player, the dance music excited 
correspondingly can be outputted, so that the cooperative feeling between the dance and the music can be improved. 

In another aspect of the third or fourth video dance game apparatus of the present invention, the apparatus is fur- 
ther provided with a dance music control device for controlling the dance music output device to change the music sig- 

5 nal outputted therefrom in accordance with the read dance performance data piece. 

According to this aspect, under the control of the dance music control device, the music signal outputted from the 
dance music output device is changed in accordance with the read dance performance data piece. Therefore, in case 
that the external operation for the combined or pair dance performance to obtain a high game score is inputted by the 
game player, the dance music excited correspondingly can be outputted. so that the cooperative feeling between the 

10 dance and the music can be improved. 

In arlother aspect of the first or second video dance game apparatus of the present invention, the apparatus is fur- 
ther provided with: a basic movement data memory device for storing a plurality of basic movement data pieces to 
change the image in various manners respectively such that the dancers perform a predetermined movement in 
accordance with the outputted dance music when the image of the dancers is not changed in correspondence with the 

15 read dance performance data piece; a basic movement level setting device for setting a basic movement level on the 
basis of the time lag between the read-out timing and the generation timing; a basic movement data selecting and read- 
ing out device for selecting and reading out one of the basic movement data pieces in accordance with the basic move- 
ment level set by the basic movement level setting device; and a basic movement control device for controlling the 
image displaying device to change the image of the dancers such that the dancers perform the predetermined move- 

20 ment corresponding to the read out basic movement data piece, when the image of the dancers is not changed in cor- 
. respondence with the read dance performance data piece. 

^ According to this aspect, when the dance performance data piece is read out. the basic movement level is set by 
the basic movement level setting device on the basis of the time lag between the read-out timing and the generation 
timing. Then,- one of the basic movement data pieces Stored in the basic movement data memory device is selected 

25 and read out by the basic movement data selecting and reading out device, in accordance with the basic movement 
level set by the basic movement level setting device. When the image of the dancers is not changed in correspondence 
with the read dance performance data piece, under the control of the basic movement control device, the image of the 
dancers is changed by the image displaying device such that the dancers perform the predetermined movement corre- 
sponding to the read out basic movement data piece. Therefore, even when the external operation is not inputted by the 

30 operation device, the image of the dancers is changed so as to perform the predetermined movement Thus, the dance 
performance can be played in a manner similar to the real dance actions. Further, by setting the basic movement level 
to the higher level as the external operation to obtained the higher game score is inputted, the predetermined move- 
ment after the dance performance based on the external operation becomes the higher performance. Accordingly, the 
video dance game can be even more Improved. 

35 In another aspect of the third or fourth video dance game apparatus of the present invention, the apparatus is fur- 
ther provided with: .a basic movement data memory device for storing a plurality of basic movement data pieces to 
change the image in various manners respectively such that the dancers perform a predetermined movement in 
accordance with the outputted dance music when the image of the dancers is not changed in correspondence with the 
read dance performance data piece; a basic movement level setting device for setting a basic movement level on the 

40 basis of the read dance performance data piece; a basic movement data selecting and reading out device for selecting 
and reading out one of the basic movement data pieces in accordance with the basic movement level set by the basic 
movement level setting device; and a basic movement control device for controlling the image displaying device to 
change the image of the dancers such that the dancers perform the predetermined movement corresponding to the 
read out basic movement data piece, when the image of the dancers is not changed in correspondence with the read 

45 . dance performance data piece. 

According to this aspect, when the dance performance data piece is read out, the basic movement level is set by 
the basic movement level setting device on the basis of the read dance performance data piece. Then, one of the basic 
movement data pieces stored in the basic movement data memory device is selected and read out by the basic move- 
ment data selecting and reading out device, in accordance with the basic movement level set by the basic movement 

so level setting device. When the image of the dancers is not changed in correspondence with the read dance perform- 
ance data piece, under the control of the basic movement control device, the image of the dancers is changed by the 
image displaying device such that the dancers perform the predetermined movement corresponding to the read out 
basic movement data piece. Therefore, even when the external operation is not inputted by the operation device, the 
Image of the dancers is changed so as to perform the predetermined movement. After the external operation for the 

55 combined or pair dance performance is inputted and the combined or pair dance performance is played in the displayed 
image, the dancers in the combined or pair state performs the predetermined movement, so that the dance perform- 
ance can be played In a manner similar to the real dance actions. Further, by setting the basic movement level to the 
higher level as the external operation to obtained the higher game score is inputted, the predetermined movement after 
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the dance performance based on the external operation becomes the higher performance. Accordingly, the video dance 
game can be even more improved. 

In the above mentioned aspects of the first to fourth video dance game apparatuses in which the apparatus is pro- 
vided with: the basic movement data memory device; the basic movement level setting device; the basic movement 

5 data selecting and reading out device; and the basic movement control device, of the present invention, the dance per- 
formance data memory device may store s plurality of dance performance data pieces indicating dance performances 
which movements are different from each other with respect to one kind of dance performance. And that, the dance per- 
formance data selecting and reading out device may select and read out one of the dance performance data pieces 
stored In the dance performance data memory device in accordance with the basic movement level. 

10 According to this aspect, a plurality of dance performance data pieces indicating dance performances which move- 
ments are different from each other with respect to one kind of dance performance, are stored in the dance perform- 
ance data memory device. In operation, one of the dance performance data pieces stored in the dance performance 
data memory device is selected and read out by the dance performance data selecting and reading out device, in 
accordance with the basic movement level. Therefore, as the basic movement level is the higher, the dance perform- 
To ance data piece for the dance performance in the higher degree of movement with respect to the same kind of dance 
performance is selected. Thus, in case that the external operation to obtain a high game score is inputted, not only the 
predetermined movement when the external operation is not inputted but also the dance performance itself based on 
the external operation becomes the higher. Therefore, the musical sense and/or the artistic sense as for the dance can 
be even more reflected onto the video dance game. 

so Also in the above mentioned aspects of the first to fourth video dance game apparatuses in which the apparatus is 

provided with: the basic movement data memory device; the basic movement level setting device; the basic movement 
data selecting and reading out device; and the basic movement control device, of the present invention, the apparatus 
may be further provided with a dance music control device for controlling the dance music output device to change the 
music signal outputted therefrom in accordance with the basic movement level. 

25 According to this aspect, under the dance music control device, the music signal outputted from the dance music 
output device is changed in accordance with the basic movement level. Therefore, in case that the external operation 
to obtain a high game score Is inputted by the game player, not only the predetermined movement when the external 
operation is not inputted becomes excited, but also the outputted dance music becomes excited correspondingly, so 
that the cooperative feeling between the dance and the music can be improved. 

30 The above described first video dance game apparatus may be realized by a first program storage device readable 
by a computer for a video dance game, tangibly embodying a program of instructions executable by the computer to 
perform method processes for displaying an image of at least two dancers on a screen and controlling the dancers in 
the displayed image to play various dance performances in accordance with an external operation by a game player to 
thereby offer a dance game to the game player, the program storage device storing a plurality of dance periormance 

35 data pieces each indicating respective one of the various dance performances, the computer having an operation 
device by which the external operation is inputted. The method processes are provided with: displaying the image of 
the dancers on the screen; outputting a music signal indicating a dance music; generating beat information on the basis 
of the music signal; selecting and reading out one of the dance performance data pieces stored in the program storage 
device, in accordance with the external operation when the external operation Is inputted by the operation device so as 

40 to change the dance performance of the dancers on the screen; changing the image of the dancers on the screen such 
that the dancers play a dance performance corresponding to the read out dance performance data piece; and calculat- 
ing a game score on the basis of a time lag between a read-out timing, which is a timing at which the dance perform- 
ance data piece is read out in accordance with the external operation, and a generation timing of the beat information, 
which is a timing at which the beat information is generated. 

45 The above described second video dance game apparatus may be realized by a second program storage device 
readable by a computer for a video dance game, tangibly embodying a program of instructions executable by the com- 
puter to perform method processes for displaying an image of at least two dancers on a screen and controlling the danc- 
ers in the displayed image to play various dance performances in accordance with an external operation by a game 
player to thereby offer a dance game to the game player, the program storage device storing a plurality of dance per- 

50 formance data pieces each indicating respective one of the various dance performances, the computer having an oper- 
ation device by which the external operation is inputted. The method processes are provided with: displaying the image 
of the dancers on the screen; outputting a rfi'usic signal indicating a dance music; generating beat Information on the 
basis of the music signal; selecting and reading out one of the dance performance data pieces for at least one of the 
dancers stored in the program storage device, in accordance with the external operation when the external operation is 

55 inputted by the operation device so as to change the dance performarKie of the at least one of the dancers on the 
screen; selecting and reading out another of the dance performance data pieces for another of the dancers in a prede- 
termined order and at a predetermined timing which are set in advance for the another of the dancers; changing the 
Image of the dancers on the screen such that the dancers play a dance performance corresponding to the read out 
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dance performance data piece; and calculating a game score on the basis of a time lag between a read-out timing, 
which is a timing at which the dance performance data piece is read out in accordance with the external operation, and 
a generation timing of the beat information, which is a timing at which the beat information is generated. 

The above described third video dance game apparatus may be realized by a third program storage device reada- 

£ ble by a computer for a video dance game, tangibly embodying a program of instructions executable by the computer 
to perform method processes for displaying an image of at least two dancers on a screen and controlling the dancers 
in the displayed image to play various dance performances in accordance with an external operation by a game player 
to thereby offer a dance game to the game player, the program storage device storing a plurality of dance performance 
data pieces each indicating respective one of the various dance performances, the computer having an operation 

10 device by which the external operation is inputted. The method processes are provided with: displaying the image of 
the dancers on the screen; outputting a music signal indicating a dance music; generating beat-information on the basis 
of the music signal ;,selecting and reading out one of the dance performance data pieces stored in the program storage 
device, in accordance with the external operation when the external operation Is inputted by the operation device so as 
to change the dance performance of the dancers on the screen; changing the image of the dancers on the screen such 

75 that the dancers play a dance performance corresponding to the read out dance performance data piece; judging a 
mutual relation between the dancers in the displayed image; permitting the selecting and reading out process to select 
the one of the dance performance data pieces only from among the dance performance data pieces each indicating 
such a dance performance that movements of the dancers are interlocked with each other, in case that the judged 
mutual relation is a predetermined relation; and calculating a game score on the basis of the read out dance perform- 

20 ance data piece in correspondence with the external operation. 

The above described fourth video dance game apparatus may be realized by a fourth program storage device read- 
able by a computer for a video dance game, tangibly embodying a program of instructions executable by the computer 
to perform method processes for displaying an image of at least two dancers on a screen and controlling the dancers 
in the displayed image to play various dance performances in accordance with an external operation by a game player 

25 to thereby offer a dance game to the game player, the program storage device storing a plurality of dance performance 
data pieces each indicating respective one of the various dance performances, the computer having an operation 
device by which the external operation is inputted. The method processes are provided with: displaying the image of 
the dancers on the screen; outputting a music signal indicating a dance music; generating beat information on the basis 
of the music signal; selecting and reading out one of the dance performance data pieces for at least one of the dancers 

30 Stored in the program storage device, in accordance with the external operation when the externa! operation is inputted 
by the operation device so as to change the dance performance of the at least one of the dancers on the screen; select- 
ing and reading out another of the dance performance data pieces for another of the dancers in a predetermined order 
and at a predetermined timing which are set in advance for the another of the dancers; changing the image of the danc- 
ers on the screen such that the dancers play a dance performance corresponding to the read out dance performance 

35 data piece; judging a mutual relation between the dancers in the displayed image: permitting the selecting and reading 
out process to select the one of the dance performance data pieces only from among the dance performance data 
pieces each indicating such a dance performance that movements of the dancers are interlocked with each other, in 
case that the judged mutual relation is a predetermined relation; and calculating a game score on the basis of the read 
out dance performance data piece in correspondence with the external operation. 

40 According to the first to fourth program storage devices, such as a CD-ROM. a DVD-ROM. a ROM. a floppy disk or 

the like, of the present invention, the above described first to fourth video dance game apparatuses of the present inven- 
tion can be respectively realized as the computer tor the video dance game reads the dance performance data pieces 
and the program of instructions from respective one of the first to fourth program storage devices, and executes the 
read program by use of the read dance performance data pieces. 

45 , The first to fourth program storage devices may further store the aforementioned basic movement data pieces to 
change the image in various manners respectively such that the dancers perform a predetermined movement in 
accordance with the butputted dance music when the image of the dancers is not changed in correspondence with the 
read dance performance data piece. Also, the first to fourth program storage devices may further store the aforemen- 
tioned dance performance data pieces indicating the dance performances which movements are different from each 

so other with respect to one kind of dance performance. 

The nature, utility, and further features of this invention will be more clearly apparent from the following detailed 
description with respect to preferred embodiments of the Invention when read in conjunction with the accompanying 
drawings briefly described below. 

55 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a video dance game apparatus as a first embodiment of the present invention; 

FIG. 2 is a perspective view of one example of an operation section in the video dance game apparatus of FIG. 1 ; 
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FIG. 3 is a flowchart showing one portion of an operation of the first embodiment: 
FIG. 4 is a flowchart showing another portion of the operation of the first embodiment; 
FIG. 5 is a flowchart showing another portion of the operation of the first embodiment; 
FIG. 6 is a flowchart showing another portion of the operation of the first embodiment; 
5 FIG. 7 is a timing chart showing a detection timing of a beat signal in a second embodiment of the present inven- 

tion; 

FIG. 8 is a timing chart showing a relation between dance music data and score ratio data In a fourth embodiment 
of the present invention; 

FIG. 9 is a flowchart showing one portion of an operation of a seventh embodiment of the present invention: 
70 FIG. 10 is a flowchart showing another portion of the operation of the seventh embodiment; 
FIG. 1 1 is a flowchart showing another portion of the operation of the seventh embodiment; 
FIG. 12 is a flowchart showing another portion of the operation of the seventh embodiment; 
FIG. 13 is a flowchart showing another portion of the operation of the seventh embodiment; and 
FIG. 14 is a perspective view of a modified embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will be now explained, with referring to the accompanying drawings. 

20 [First Embodiment] 

At first, a first embodiment is explaCined with reference to FIGs. 1 to .6. FIG. 1 is a block diagram showing a sche- 
matic configuration of a video game apparatus of this embodiment. 

In FIG. 1, the video game apparatus is provided with: a CPU (Central Processing Unit) 1, a program/data ROM 
25 (Read Only Memory) 2; a data RAM (Random Access Memory) 3; a game sound source 4; a speaker 5: an operation 
section 6; a polygon parameter memory 7; a polygon data memory 8: a coordinates conversion processing device 9: a 
polygon paint device 10; a frame memory 1 1 ; and a display device 12. 

The program/data ROM 2 and the data RAM 3 are connected to the CPU 1 through a communication bus. The CPU 
1 runs a program of a game stored in the program/data ROM 2 as one example a program storage device on the basis 
30 of the data stored in the data RAM 3. Moreover, the CPU 1 performs calculations such as a coordinates conversion and 
the like, as described later. 

A dance music slghal including a beat signal data Is outputted from the game sound source 4 as one example of 
the dance music output device. The game sound source 4 may include a reproducing device such as a CD player, a 
DVD player or the like to reproduce a music sound from an information record medium such as a CD, a DVD or the like. 
35 This beat signal data is inputted to the CPU 1 . The CPU 1 detects a timing at an on-beat, on the basis of this beat signal 
data, and then compares this timing at the on-beat with a timing of a played performance to thereby calculate a score. 
That is, the CPU 1 functions as one exanple of the beat information generating device and also one example of the 
score calculating device. 

The operation section 6 as one example of the operation device is provided with a plurality of normal push buttons 
40 and/or cross-arranged push buttons disposed on an operation panel of the video game apparatus to thereby set a kind 
of a performance based, on a selection of a pressed push button and a pressed order. Moreover, not only the above 
mentioned buttons, but also two drive levers 6a and 6b, which can be moved respectively forward and backward as 
shown in FIG. 2, may be employed, so that the kind of the perforrhance may be set on the basis of the moved direction 
and the moved amount of the drive levers 6a and 6b. For example, the left drive lever 6a is set so as to operate a leh 
45 half body of a dancer on a screen of the display device 1 2, and the right drive lever 6b is set so as to operate a right half 
body of the dancer on the screen. Then, it is possible to respectively throw down onto this side and a forward side to 
thereby let the dancer perform a movement on the screen as shown in a TABLE 1 . In the TABUE 1 , a reference mark 
"L" denotes the left drive lever 6a. "R" denotes the right drive lever 6b, denotes an operation that the drive lever 6a 
or 6b is thrown down onto the forward side, and "t" denotes an operation that the drive lever 6a or 6b is thrown down 
so onto this side. ^ ^ 
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TABLE 1 



Lever Direction 


Movement From Standing Position 


LT RT 


Apply Force Forward 


L i Ri 


Apply Force Backward 


LI R 1 L 4- R 4. 


Suddenly Move Weight Backward 


LiRiLTRT 


Suddenly Move Weight Forward 


LT Ri" 


Right Pivot 


Li RTLtRi 


Right Turn 


Li RT 


Left Pivot 


lTrJ-LsLrT 


Left Turn 



In this embodiment, in order to give more reality to the dancer's movement, the dancer, the background and the like 
are represented by three-dimensional coordinates in the form of a polyhedron, which is a set of polygonal planes. Val- 
20 ues of the coordinates in the three<iimensional coordinates frarpe at each of the vertexes of the polygonal planes are 
converted into coordinates of a display element having a two-dimensional display plane on the screen of the display 
^■device 12. This conversion is carried out for each polygonal plane, and is then displayed on the screen. 

Such a polygonal plane is referred to as a "polygon". In this embodiment, the value of the coordinates at each ver- 
tex of the polygon of the dancer and the background are stored in the polygon data memory 8 as the polygon data, and 
25 are used as fixed physical information within a three-dimensional space. 

Position information with respect to two dancers, color information and a coordinates conversion equation related 
to the position irrformation are stored in the polygon parameter memory 7. 

A coordinates conversion processing device 9 as one example of the image control device reads a content stored 
in the polygon parameter memory 7 to thereby perform a coordinates conversion process for the polygon data, and fur- 
30 ther performs a coordinates conversion process so as to project the coordinates-converted polygon data in the three- 
dimensional coordinates frame onto the screen. The polygon paint device 10 as one example of the image displaying 
device reads a light source parameter from the polygon data memory 8. performs the coloring process and the like for 
the coordinates-converted polygon data, writes the polygon data to the frame memory 11, and then reads it out after 
writing ail the polygon data to thereby output it to the display device 12. 
35 The data is written to the frame memory 1 1 in order to determine the order of drawing in consideration with a dis- 
tance of a deep direction on the screen. That is, it is necessary to register each polygon data in the memory, sort them 
at a time of drawing, read out in the order of decreasing a length in the deep direction on the screen and then draw them 
in the frame memory 11. 

In the above mentioned configuration, when a game player operates the operation section 6 provided with the drive 
40 levers 6a and 6b (in FIG, 2) and the like to thereby change a pose and a position of the dancer, the CPU 1 as one exam- 
ple of the dance performance data selecting and reading out device selects and reads out the position of the dancer 
and the coordinates conversion equation with regard thereto as the dance performance data, from the program/data 
ROM 2 as one example of the dance performance data memory device, and momentarily stores the read out position 
of the dancer and the coordinates conversion equation with regard thereto, into the polygon parameter memory 7. 
45 Then, the coordinates conversion processing device 9 reads out the fixed physical information stored in the polygon 
data memory 8 and the dancer's position and the coordinates conversion equation stored in the polygon parameter 
merriory 7, and then coordinates -converts the fixed physical information, such as the background and the like, with 
respect to a relatively observing point for the dancer at that time, and further performs the coordinates conversion proc- 
ess so as to project the coordinates-converted polygon data in the three-dimensional coordinates frame onto the 
so screen. The writing operation to the frame memory 1 1 is carried out by sending the thus-obtained information to the pol- 
ygon paint device 10. Hence, by reading it out. the substantially three-dimensional image is depicted on the screen of 
the display device 12. 

Next, an operation of the video dance game apparatus of this embodiment having the above mentioned configura- 
tion is explained with reference to flowcharts in FIGs. 3 to 6. As shown in the flowchart of FIG. 3. a menu screen is dis- 
ss played at first (Step SI). Then, a category (genre) of a dance to be competed is selected (Step S2). Each dance is 
classified on the basis of a kind of a beat signal. When a dance is selected, the selected dance category data is read 
from the ROM 2 (Step S3), and this is set and stored into the RAM 3 (Step S4). Next, a dancer is selected (Step 85). 
For each dancer, the level data of a plurality of body feature items is set for each of a personal performance and a com- 
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bination performance. A score is calculated when the performance is played in accordance with the level data for each 
of the body feature items. 

For example, a level indicating a heavy weight.as for a body weight item among the body feature items is set for a 
dancer A. Thus, if the game player operates so as to play a performance of a jump, a score becomes low. The dancer 

5 A is set so as not to take an excessive jump also on the screen. Moreover, a level indicating an excellently speed feeling 
as for a speed feeling item among the body feature items is set for a dancer B. Thus, if the game player operates so as 
to consecutively play the performance, the score becomes high. 

Then, in a case that any one of the dancers is selected, the selected dancer data is read from the program/data 
ROM 2 (Step S6). and is set and stored into the data RAM 3 (Step S7). 

10 Next, music data based on the selected dance category data is sent to the game sound source 4 (Step S8), and 
the dance music is reproduced. A beat signal is also included in the music data. The polygon data with regard to the 
dancer at the beginnigg of the game is set in the polygon parameter memory 7 (Step S9). The polygon data with regard 
to the background at the beginning of the game is read from the polygon data memory 8 (Step SIO). Then, the coordi- 
nates conversion process is performed by the coordinates conversion processing device 9 (Step S1 1). The converted 

15 polygon data is written into the frame memory 1 1 by the polygon paint device 10 (Step SI 2), and is displayed on the 
display device 12 (Step S13). 

Next, as shown in the flowchart of FIG. 4. a competition time counter as one example of the time measuring device 
is set to a predetermined value (for example. 5 minutes) (Step S14). A remaining time counter is set to a predetermined 
value (for example. 1 minute) (Step SIS). The competition time is a time period during which the dance music is repro- 

20 duced, and is set in the dance category data. The remaining time is a time period during which the game player can 
operate the dancer, and is set in such a way that the competition time is longer than the remaining time at the beginning 
of the game. As described later, since the game player plays the performance for the dancer, a time corresponding to 
the score is added to the remaining time by the CPU 1 as one example of the time adjusting device, and thereby a time 
period during which the dancer can be operated is extended. On the other hand, when the dance music is finished 

23 because of an expiration of the competition time, the remaining time at that time is converted into the score and Is then 
displayed. When the remaining time is expired while the dance music is reproduced, the game is finished. 

In order to execute the above mentioned process, the competition time counter is firstly down -count-driven and the 
result is displayed (Step S16). The remaining time counter is down-count-driven and the result is displayed (Step S17). 
Next, it is judged whether or not the remaining time counter is zero (Step SI 8). If it is zero (Step SI 8: YES), the game 

30 is finished. If it is not zero (Step SI 8: NO), it is judged whether or not the dance is finished when the competition time 
counter is zero (Step SI 9). If it is finished (Step SI 9: YES), the conversion of the remaining time into the score is carried 
out from the remaining time counter at that time (Step S20), and this is displayed (Step S21). 

If it is not zero (Step S19: NO), the polygon parameter data for the two dancers is changed on the basis of the 
dance music data, and the changed data is set in the polygon parameter memory 7 (Step S22). The polygon data with 

35 regard to the background at that time is read from the polygon data memory 8 (Step S23). and the coordinates conver- 
sion process is performed (Step 824). Then, the converted polygon data is written into the frame memory by the poly- 
gon paint device 10 (Step S25), and is displayed on the display device 12 (Step S26). That is, such a display that an 
appropriate dance is performed by moving the image of the two dancers is carried out by the processes at the steps 
S22toS26. 

40 Then, the GPU 1 as one example of the position judging device detects a position, a distance and the like in the 
polygon data of the two dancers, so as to judge the relation between the polygon data of one dancer and the polygon 
data of the other dancer (Step S27). Then, the CPU 1 judges whether or not it is a timing at which the combination per- 
formance can be played (Step S28). 

If it is not the timing at which the combination performance can be played (Step S28: NO), as shown in the flowchart 

45 of FIG. 5. the CPU 1 judges whether or not a combination lamp for indicating the timing at which the combination per- 
formance can be played is displayed (Step S29). If the combination lamp is displayed (Step S29: YES), the display of 
the combination lamp is extinguished (Step S30). After the step S29 (NO) or S30, the game player operates the oper- 
ation section 6 so that the displayed dancer plays the performance, and then it is judged whether or not the polygon 
data for the dancer is changed (Step S31). 

so If it is not changed (Step 831: NO), the operational flow returns to the step S18 in FIG. 4: In FIG. 5 again, if it is 

changed (Step S31 : YES), the CPU 1 judges the kind of the operated performance (Step S32), and then detects a time 
lag or shift between the timing when the operation section 6 is operated (i.e.. the performance Is played) and the timing 
of the beat signal of the dance music (Step S33). Then, the CPU 1 judges whether or not there is any relation between 
the previous performance and the present performance when the game player operates to consecutively play the per- 

55 formance, by detecting a relation to the dancer polygon data prior to the operation (Step 834). Then, the CPU 1 judges 
whether or not there is any continuity between the previous performance and the present performance when the game 
player operates to consecutively play the performance, by detecting a timing when the operation section 6 is continu- 
ously operated (Step S35). Then, the CPU 1 as one example of the score calculating device calculates the score based 
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on the judgment results at the steps S32 to S35 (Step S36). and calculates the remaining time corresponding to the 
score to thereby update (add) the remaining time counter (Step S3 7). 

Next, the polygon parameters changed in a similar manner as to the steps 89 to S13 are set in the polygon param- 
eter memory 7 (Step S38). The background polygon data at that time is read from the polygon data memory 8 (Step 
£ S39). The coordinates conversion process is performed by the coordinates conversion processing device 9 (Step S40). 
Then, the processed result is written into the frame memory 1 1 (Step S41). and is then displayed on the display device 
12 (Step S42). That is. by the processes at the steps S29 to S42. the display is carried out so as to play the personal 
performance such that the performance is played for the dancer whom the game player intends to operate, irrespective 
of the other dancer. 

10 On the other hand, when judging at the step S28 in FIG. 4 that it is the timing of playing the combination perform- 

ance (step 828: YES), the combination lamp is displayed as shown in the flow chart of FIG. 6 (Step 843). Then, it is 
judged whether or not the polygon data of the dancer is changed, as the game player operates the operation section 6 
so that the displayed dancer plays the performance (Step S44). If it is not changed (Step 844: NO), the operational flow 
returns to the step 818 in FIG. 4. Namely, the state in which this combination lamp is displayed is such a state that the 

75 CPU 1 as one example of the dance performance data selection permitting device allows the selection of the combina- 
tion performance, so that, if the polygon data is changed by the operation of the operation section 6 so as to play the 
combination performance (Step S44: YES), the kind of the operated combination performance is judged (Step S45). 
Then, a time lag or shift between the timing when the operation section 6 is operated and the timing of the beat signal 
of the dance music is detected (Step 846). Then, the distance and positional relation between the polygon data of one 

20 dancer and the polygon data of the other dancer are detected (Step S47). Next, a time relation between the timing when 
the performance is played by the dancer whom the game player operates by the operation section 6 so as to move it. 
^md the timing when the performance is played by the other dancer is detected. That Is. the time relation (lag) between 
the changed timings of the polygon data for the two dancers is detected (Step S48). 

Next, by detecting the timing when the operation section 6 is continuously operated, it is judged whether or not 

25 there is a continuity between the previous performance and the present performance when the game player operates 
to continuously play the performance (Step 849). Then, the score is calculated on the basis of the judgment results of 
the steps 845 to 849 (Step 850). The remaining time corresponding to the score is calculated, and the remaining time 
counter is updated (added) (Step 851). 

The processes same as those at the steps 838 to 842 are performed (Steps 852 to 856). In this manner, by the 

30 processes at the steps 843 to S56. the display is performed so as to play the combination performance in such a way 
that a performance is simultaneously played by the dancer whom the game player intends to operate and the other 
dancer. 

As mentioned above, according to the present embodiment, the game player can obtain a high score by playing 

various dance performances in harmonization with the beat timing of the dance music, and can enjoy a time-extended 
35 play based on the score. Thus, it is possible to compete not only for the conventionally simply operational skill but also 

for a music sense or an art sense with regard to the dance, and thereby possible to realize an enjoyment which has 

never been experienced before. 

Moreover, the combination performance can be played by operating in such a way that the two game players let the 

two dancers play the dance. Accordingly, the score is affected by not only the time lag or shift with respect to the above 
40 mentioned beat timing, but also the time lag or shift between the timings of the dance performances played by the two 

dancers. Hence, it is possible to enjoy a new game in which the cooperation between the game players is competed. 

which has never been experienced before. 

[Second Embodiment] * 
45 . 

Next, a second embodiment of the present invention is explained with reference to FIG. 7. Explanations of the por- 
tions common to the first embodiment are omitted. 

In the first embodiment, the timing of the on-beat and the timing of the played performance are detected as shown 
in FIG. 7, and the score is calculated on the basis of the time lag or shift between both of these timings. However, in the 
so second embodiment, a timing of an off-beat and the timing of the played performance are detected as shown in FIG- 7 
to thereby calculate the score on the basis of the time lag or shift between both of these timings. 

In this manner, since the score can be' calculated at any of the beat timings, the appropriate score can be calculated 
on the basis of the kind of the dance music. 

£5 [Third Embodiment] 

Next, a third embodiment of the present invention is explained. Explanations of the portions common to the first 
embodiment are omitted. 
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In the first embodiment, the case where the two dancers are externally operated by the respective game players is 
explained. However, in addition to the above mentioned mode, a mode is included in the third embodiment, in which one 
dancer is externally operated while the other dancer is automatically controlled to play a dance according to a program 
which is stored in advance by the CPU 1 as one example of the readout control device. 
5 For example, in a case of a social dance in which a step is defined, even one game player can enjoy the game by 

including such a mode. 

[Fourth Embodiment] 

10 Next, a fourth embodiment of the present invention is explained. Explanations of the portions common to the first 

embodiment are omitted. " 

In this embodirrtent. a score is set in accordance with a flow of a dance music. For example, as shown In FIG. 8, 

the dance music data has score ratio data with respect to a reproduction output of the dance music on a time axis. 

Then. If a performance is played when the dance music is at the climax, the score is set larger than that of the case 
15 where the same performance is played at a time of another reproduction. 

For example, even if a certain performance has five points, a ratio is defined as 0.7 for a case that the performance 

is played when the dance music is not excited. Then, if the performance is played when the dance music is not excited, 

the score becomes 5 x 0.7 = 3.5. On the other hand, the ratio is defined as 1.5 for a case that the dance music is 

excited. Then, if the performance is played at this time, the score becomes 5 x 1 .5 = 7.5. 
20 According to this embodiment, the music sense or the art sense is required more and more. Hence, the pleasure 

of the game can be increased. 

[Fifth Embodiment] 

25 Next, a fifth embodiment of the present invention is explained. Explanations of the portions common to the first 

embodiment are omitted. 

The personal performance and the combination performance are preset in the above mentioned embodiments. 
However, the fifth embodiment has a function of editing a performance, and thereby a game player can prepare a desir- 
able performance by the external operation and set it in advance of actually playing the game. For example, for a certain 

30 performance, it is possible to set a dancer's pose before a performance is played by a game player and a dancer's pose 
after the performance is played. Then, if the operation section 6 is operated to play this performance, it is possible to 
carry out such a sequential display that the dancer has the pose before the performance is played, the performance is 
played, and the dance has the pose after the performance is played. 

Actually, the image data and the like corresponding to the operation of the operation section 6 may be read out from 

35 the program/data ROM 2 by the CPU 1 as one example of the editing device, and may be stored Into the data RAM 3 
and the like, as the user data, in accordance with the operation of the operation section 6. while the selected pose is 
displayed on the display device 12 by the polygon paint device 10 and the like. 

[Sixth Embodiment] 

40 

Next, a sixth embodiment of the present invention is explained. Explanations of the portions common to the first 
embodiment are omitted. 

In the above mentioned embodiments, the information record medium, such as a CD, a DVD or the like installed in 
the dance game apparatus, may be used as the source of the dance music by the game sound source 4. In the infor- 
ms mation record medium, the dance music dedicated to the game apparatus is stored, such that not only the music data, 
but also the score ratio data may be stored in advance. 

However, the present invention is not limited to it. Namely, the sixth embodiment is adapted to reproduce a general 
dance music CD as the information record medium. In this case, "rt may be provided with an extract device, constructed 
as one hardware unit or constructed in the CPU 1 according to the computer program, for extracting a beat component 
50 from a reproduction signal of the music CD by using a filter and the like. 

[Seventh Embodiment] 

Next, a seventh embodiment of the present invention is explained with reference to FIGs. 9 to 13. Explanations of 
55 the portions common to the first embodiment are omitted. 

The seventh embodiment has an idling function of displaying a dynamic picture of a dancer in a basic movement 
conresponding to a dance music, even if an irput operation for the performance is not canried out for the dancer by the 
operation section 6. The displayed picture on the display device 1 2 in this idling state is dynamically changed in accord- 
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ance with the input operation of the performance for the dancer, and the dance music is also dynamica!ly changed. 

An operation of the video dance game apparatus in this embodiment is explained with reference to flowcharts in 
FIGs. 9 to 13. In these flowcharts, same steps as those in the flowcharts of FlGs. 3 to 6 used in the first embodiment 
carry the same step numbers, and the detailed explanations thereof are omitted. 

5 As shown in FIG. 9. this embodiment is similar to the f irst embodiment up to the step where the dance category and 

the dancer are selected and each data is stored into the data RAM 3 (Steps S1 to S7). However, in this embodiment, 
after that, an idling/music level as a basic movement level is set to "1 " by the CPU 1 as one example of the basic move- 
ment level setting device (Step Si 00). This idling/music level is referred to when determining the variation degrees of 
the dancer's movement and the dance music in the idling state. As the operation by which a higher score can be 

10 obtained is carried out. the idling/music level is also set to a higher value. 

When a music level is read out by the CPU 1 as one example of the dance music control device, since a first music 
level is "1" (i.e. aM^vel at the beginning), the music data corresponding to the music level "1" is sent to the game sound 
source 4 by the CPU 1 as one example of the dance music control device, on the basis of the dance category data (Step 
8101). When an idling level is similarly read out by the CPU 1 as one example of the basic movement level selecting 

15 and reading out device, since the idling level is "1 " at first, the basic movement data is read out so as to let the dancer 
play an idling dynamic picture operation (e.g., stepping of taps) corresponding to the idling level "1". That is, a position 
of the dancer and a coordinates conversion equation with regard thereto as the basic movement data are selected and 
read out from the program/data ROM 2 as one example of the basic movement data memory device, by the CPU 1 as 
one example of the basic movement level selecting and reading out device, and then the position of the read out dancer 

20 and the coordinates conversion equation with regard thereto are set and stored into the polygon parameter memory 7 
;(Step S102). Moreover, the polygon data with regard to the background corresponding to the idling/music level "1" is 
■^read out from the polygon data memory 8 (Step S103). Then, the coordinates conversion process is performed by the 
coordinates conversion processing device 9 as one example of the basic movement control device similarly to the first 
embodiment (Step S1 1). The converted polygon data is written into the frame memory 11 by the polygon paint device 

25 10 (Step 812). and is then displayed on the display device 12 (Step S13). Thanks to the above mentioned processes, 
even if the external input is not carried out from the operation section 6, the dancer in the idling state can be moved in 
harmonization with the beat of the dance music. Hence, it is possible to really represent the dancer's movement. 

As shown in FIG. 10. after the competition time counter and the reniaining time counter are set similarly to the first 
embodiment (Steps SI 4 to S15), the competition time counter and the remaining time counter are driven and displayed 

30 (Steps S16 to 817). Then, while it is judged whether or not the remaining time counter and the competition time counter 
become zero (Steps 818 to 81 9). the operational flow is in a waiting state for an input request of the dance performance 
data. 

The waiting state for the input request of the dance performance data while counting the time as mentioned above 
is similar to the first embodiment. However, in this embodiment, even if the dance performance data is not inputted, the 
35 dancer's pose and the dance music are dynamically changed on the basis of the idling/music level. Moreover, the value 
of the idling/music level is also changed. 

That is. if the values of the remaining time counter and the competition time counter are not zero (Step 818 ; NO. 
Step S19; NO), it is judged by the CPU 1 as one example of the basic movement control device whether or not a pre- 
determined time (for example. 30 seconds) is elapsed after that (Step SI 04). If it is elapsed (Step SI 04: YES), jt is 
40 judged whether or not the idling/music level is the lowest level (Step 8105), Then, if the predetermined time is elapsed 
when it is "1 " indicating the lowest level (Step 8104 ; YES, Step 8105; YES), the game is finished. 

However, if it does not become the highest level even after the elapse of the predetennined time (Step Si 05 ; NO), 
after the process of reducing the idling/music level by "1 " is carried out by the CPU 1 as one example of the basic move- 
mentlevel setting device (Step 8106). or if the predetermined time is not elapsed (Step S104 ; NO), the operational flow 
45 proceeds to the processes of the music data and the display data shown in FIG, 1 1 , while the idling/music level is main- 
tained at the original state. 

Then, as shown in FIG. 1 1 . the music data corresponding to the music level is sent to the game sound source 4 by 
the CPU 1 as one example of the dance music control device (Step S1 07). Moreover, the polygon data of the two danc- 
ers is changed by the CPU 1 as one example of the basic movement level selecting and reading out device, on the basis 
50 of the idling level, and is then set into the polygon parameter memory 7 (Step S108). Further, similarly to the first 
embodiment, the polygon data with regard to the background at this time is read from the polygon data memory 8 (Step 
823). The coordinates conversion process Is performed (Step 824). The converted polygon data is written into the 
frame memory 1 1 by the polygon paint device 10 (Step 825). and is then displayed on the display device 12 (Step 826). 

The idling/music level becomes gradually lower, if the dance performance data is not inputted within the predeter- 
£5 mined time period, by carrying out the above mentioned processes, so that the dancer's movement and the dance 
music are changed into poor levels. Actually, the movement in the idling operation of the dancer becomes smaller, and 
the level of the dance music becomes lower, or the music becomes darker. Incidentally, although the predetermined 
time period is also measured by the counter, a value of the counter is set to an original value each time the external 
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input is carried out 

After that, it is judged whether or not the idling/music leva! is the highest level (Step S109). If it is the highest level 
(Step S109; YES), the position, the distance and the like of the two dancers are detected by the CPU 1 as one example 
of the position judging device, similarly to the first embodiment (Step S27). Then, it is judged whether or not it is the 

5 timing when the combination performance can be played (Step 828). In this way. the combination performance can be 
played only when the idling/music level is the highest level, in this embodiment. 

If it is not the timing when the combination performance can be played (Step S28 ; NO), the process for the combi- 
nation lamp is performed similarly to the first embodiment (Steps S29 to S30). After that, the score calculation when the 
dance performance Is played by the external input and the like are performed (Steps S31 to S37). 

10 After these processes, the display process is carried out in the first embodiment. However, in the seventh embodi- 

ment, prior to the display process, the idling/music level is calculated by the CPU 1 as one example of the basic move- 
ment level setting dievice. as shown in FIG. 12 (Step Si 10). This calculation Is carried out in accordance with the 
. process of judging the kind of the performance (Step S32) and the process of judging the time lag or shift between the 
timing when the performance is played and the beat (Step S33). For example, if it is not in harmonization with the beat, 

15 the level is set lower. If it is in harmonization with the beat or if rt is a case of a higher performance, the level is set higher. 
In this embodiment, when the level is set lower, it is deaeased by When the level is set higher, it is increased by not 
less than "1". 

then, it is judged whether or not the level is to be set lower after this calculation (Step S1 11). If the level is to be 
set lower (Step S11 1 ; YES), it is judged whether or not a level prior to the setting is the lowest level (Step S1 12). If it is 

20 the lowest level (Step S1 12: YES), since the level becomes zero, the game is finished. 

^ On the other hand, if the level is not to be set lower (Step S1 1 1 ; NO), it is judged whether or not the level is to be 
set higher (Step S1 13). If the level is to be set higher (Step S1 13 ; YES), it is judged whether or not a level prior to the 
setting is the highest level (Step S114). If it is the highest level (Step S1 14: YES), the level is not set higher, and the 
highest level is maintained (Step S115). 

25 On the other hand, if the level is to be set lower (Step S1 11 : YES and Step S1 1 2: NO), or if the level is to be set 

higher (Step S1 13: YES and Step S1 14: NO), or if the level is to be maintained at its original state (Step S1 13: NO), the 
process of setting the idling/music level Is carried out (Step S1 1 6). After the step S1 1 5 (i.e.. if the level prior to the set- 
ting is the highest level even when the level Is to be set higher, and the process of maintaining at the highest level (Step 
S1 1 5) is carried out) or S 11 6, the music data corresponding to the set music level is sent to the sound source 4 by the 

30 GPU 1 as one example of the dance music control device (Step S1 17). In order that the dance performance corre- 
sponding to the idling level is displayed by the CPU 1 as one example of the dance performance data selecting and 
reading out device, the'dancer's position and the coordinates conversion equation with regard thereto as the dance per- 
formance data are selected and read out from the program/data ROM 2. Then, the read out dancer's position and the 
coordinates conversion equation with regard thereto are set and stored into the polygon parameter memory 7 (Step 

35 S1 18). Then, the display process is carried out similarly to the first embodiment (Steps S39 to S42). 

That is, in this embodiment, not only the score arid the value of the remaining time counter are changed on the 
basis of the kind and the played timing of the dance performance, but also the idling/music level is changed. Moreover, 
even rf the same dance performance is selected by the same operation, the dancer's movement and the music condition 
are differentiated on the basis of the idling/music level. 

40 For example, in a case that an operation for enabling the dancer to jump is carried out, if the idling/music level is 

high, the dancer jumps high, or if the Idling/music level is low. the dancer jumps low. Moreover, the higher is the 
idling/music level, the more gorgeous (the more excited) the dance music is. For example, as the idling/music level 
becomes higher, tones of the various instruments are added, and/or the sound volume is turned up. 

After the dance performance is displayed in accordance with the external input process by the change of the poly- 

45 gorv parameter arxl the display process as mentioned above, the operational display of the idling state corresponding 
to the idling state is carried out so as to follow the dance music, as shown in FIGs. 10 to 11. Then, the dance music 
corresponding to the music level is played (Steps SI 04 to S26). 

On the other hand, in a case of the played timing of the combination performance at the step S28 shown in FIG. 1 1 
(Step S28 ; YES), the display process of the combination lamp (Step S43) is carried out as shown in FIG. 1 3. After that, 

so it is judged whether or not the external Input Is carried out (Step S44). If the external input is carried out (Step S44: 
YES), the score is calculated from the kind and the timing of the dance performance similarly to the first embodiment, 
and the remaining time counter is updated (Steps S45 to S51). In this embodiment, the idling/music level is further cal- 
culated from the kind and the timing of the dance performance at that time, by the CPU 1 as one example of the basic 
movement level setting device (Step S1 1 9). If the level is to be set lower (Step S120 ; YES), after the idling/music level 

55 is set lower (Step S121). or if the level is not to be set lower (Step SI 20: NO), the operational flow proceeds to the next 
processes of the music data and the display data, while the idling/music level is maintained at the original state. When 
the idling/music level is already in the highest level and it is to be set higher by "1 it is maintained at the highest level. 
The music data corresponding to the music level set by the CPU 1 as one example of the dance music control 
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device is sent to the sound source 4 (Step Si 22). The polygon parameter is changed by the CPU 1 as one example of 
the dance performance data selecting and reading out device so as to display the dance performance corresponding to 
the idling level, and is set in the polygon parameter memory 7 (Step SI 23). Then, the display process is carried out sim- 
ilarly to the first embodiment (Steps S53 to S56). 

£ As mentioned above, not only the score and the value of the remaining time counter are changed on the basis of 

the kind and the timing of the dance performance, but also the idling/music level is changed, even in a case of the com- 
bination performance in this embodiment. Moreover, even if the same dance performance is selected by the same oper- 
ation, the dancer's movement and the music condition are differentiated on the basis of the idling/music level. 
Furthermore, the dancer in the idling state carries out the idling operation in the state where the combination perform- 

10 ance can be played. 

As mentrdned above, according to the present invention, the basic movement in harmonization with the music for 
the dancer is autocpatically carried out on the basis of the idling level. Hence, it is possible to implement the more real 
presentation. Moreover, the movement in the idling state is dynamically changed on the basis of the kind and the timing 
of the dance performance. Thus, the dynamically idling operation corresponds to the more dynamic dance. In a case of 
75 an undesirable dance or if it is difficult to play the dance in harmonization with the rhythm, the idling operation becomes 
gradually small. Hence, since the music sense or the art or cooperative feeling with regard to the dance can be reflected 
in the game, it is possible to improve the game feature. 

As the operation in the idling state, the steppng of the taps is considered in this embodiment. However, the present 
invention is not limited to it. Then, It is possible to move in upper and lower directions or left and right directions. Or. the 
20 operation in the idling state may be selected by the input operation from the operation section 6. 

j. According to the present embodiment, the music is changed on the basis of the dancer's movement as well as the 
exciting degree of the dance. When the dance is excited, or when a high-degree dance pose is carried out, the sound 
excited in conjunction therewith is played. Hence, the game player can create the entertainment in which the dance and 
the music are integrated with each other by the dancer's operation. 
25 It is the most desirable implementation to change the dancer's movement and the music in the idling state, as 

described in this embodiment. However, the present invention is not limited to it. It is possible to apply any one of them 
to the first embodiment and the like to thereby improve the entertainment feature. 

Further, the implementation of this embodiment may be combined with the implementations of the second to sixth 
embodiments. 

30 The case where the present invention is applied to the video game apparatus is explained in the above mentioned 
first to seventh embodiments. However, the present invention is not limited to them. 

For example, as shown in FIG. 14. the present embodiment can be realized as a modified embodiment provided 
with a personal computer 1a as one example of the computer for the video dance game and an information record 
medium 2a. such as a CD-ROM. a DVD-ROM or the like as one example of the program storage device readable by the 

35 computer. 

In this embodiment, the video dance game indicated by the above explained flow charts of FIGs. 3 to 6 and 9 to 13 
in the first to seventh embodiments is mainly performed by a CPU, a memory, a display unit and an audio unit of the 
personal computer la. The control program corresponding to any one of the above explained flow charts of the embod- 
iments is stored in the information record medium 2a in advance, and is read out therefrom through a reading device, 
40 such as a CD-ROM drive, a DVD-ROM drive or the like of the personal computer la, as the occasion demands. In addi- 
tion, the information record medium 2a may store the video and audio data for the video dance game, such as the 
dance performance data, the dance music data and so on, in addition to the control program. 

In this manner, the information record medium 2a as one example of the program storage device, tangibly embod- 
ies a program of instructions executable by the personal computer 1a to perform method processes for displaying the 
45 image of the dancers on the display unit of the personal computer la. and controlling the dancers in the displayed 
image to play various dance performances in accordance with the external operation through a key board, a mouse, a 
joy stick etc. of the personal computer la. 

The control program or the video or audio data read from the information record medium 2a may be stored in a 
RAM in the personal computer 1a, so as to speedily execute the program. Alternatively, the control program may be 
£0 stored in a ROM of the personal computer 1 a in advance, or may be received through a wire or wireless communication 
line by use of a modem of the personal computer la and is stored into the RAM of the personal computer 1a. 

In the above embodiments, the two dancers are displayed on the screen. However, it is allowaWe to display more 
than two dancers to thereby carry out the dance competition. 

55 Claims 

1. A video dance game apparatus for displaying an image of at least two dancers on a screen and controlling the 
dancers in the displayed image to play various dance performances in accordance with ah external operation to 
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thereby offer a dance game, characterized in that said video dance game apparatus comprises: 



an image displaying device (10. 11, 12) having the screen, for displaying the image of the dancers on the 
screen; 

5 a dance music output device (4, 5) for outputting a music signal indicating a dance music: 

a beat information generating device (1) for generating beat information on the basis of the music signal; 

a dance performance data memory device (2) for storing a plurality of dance performance data pieces each 

indicating respective one of the various dance performances; 

a dance performance data selecting and reading out device (1) for selecting and reading out one of the dance 
10 performance data pieces stored in said dance performance data memory device; 

an image control device (1, 7, 8, 9) for controlling said image displaying device to change the image of'ihe 
dancers sudfvthat the dancers play a dance performance corresponding to the read out dance performance 
data piece; 

an operation device (6) by which the external operation is inputted, for operating said dance performance data 
15 selecting and reading out device in accordance with the external operation to select and read out said one of 

the dance performance data pieces, so as to change the dance performance of the dancers on the screen; and 
a score calculating device (1) for calculating a game score on the basis of a time lag between a read-out timing, 
which is a timing at which the dance performance data piece is read out by said dance performance data 
selecting and reading out device in accordance with the external operation, and a generation timing of the beat 
20 information, which is a timing at which the beat information Is generated by said beat information generating 

device, 

2. A video dance game apparatus for displaying an image of at least two dancers on a screen and controlling the 
dancers in the displayed image to play various dance performances in accordance with an external operation to 

25 thereby offer a dance game, characterized in that said video dance game apparatus comprises: 

an image displaying device (10. 11. 12) having the screen, for displaying the image of the dancers on the 
screen; 

a dance music output device (4, 5) for outputting a music signal indicating a dance music; 
30 a beat information generating device (1) for generating beat information on the basis of the music signal; 

a dance performance data memory device (2) for storing a plurality of dance performance data pieces each 
indicating respective one of the various dance performances; 

a dance performance data selecting and reading out device (1) for selecting and reading out one of the dance 
performance data pieces stored in said dance performance data memory device; 
35 an image control device (1, 7, 8, 9) for controlling said image displaying device to change the image of the 

dancers such that the dancers play a dance performance corresponding to the read out dance performance 
data piece; 

an operation device (6) by which the external operation is inputted, for operating said dance performance data 
selecting and reading out device in accordance with the^xternal operation to select and read out said one of 
40 the dance performance data pieces for at least one of the dancers, so as to change the dance performance of 

said at least one of the dancers on the screen; 

a read-out control device (1) for controlling said dance performance data selecting and reading out device to 
select and read out another of the dance performance data pieces for another of the dancers in a predeter- 
mined order and at a predetermined timing which are set in advance for said another of the dancers; and 
45 ■ a score calculating device (1) for calculating a game score on the basis of a time lag between a read-out timing, 
which is a timing at which the dance performance data piece is read out by said dance performance data 
selecting and reading out device in accordance with the external operation, ar>d a generation timing of the beat 
information, which is a timing at which the beat information is generated by said beat information generating 
device. 

SG 

3. A video dance game apparatus for displaying an image of at least two dancers on a screen and controlling the 
dancers in the displayed image to play various dance performances in accordance with an external operation to 
thereby offer a dance game, characterized in that said video dance game apparatus comprises: 

55 an image displaying device (10, 11. 12) having the screen, for displaying the image of the dancers on the 

screen; 

a dance music output device (4, 5) for outputting a music signal indicating a dance music; 

a beat information generating device (1) for generating beat information on the basis of the music signal; 
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a dance performance data memory device (2) for storing a plurality of dance performance data pieces each 
indicating respective one of the various dance performances; 

a dance performance data selecting and reading out device (1) for selecting and reading out one of the dance 

performance data pieces stored in said dance performance data memory device; 

an image control device (1. 7. 8, 9) for controlling said image displaying device to change the image of the 
dancers such that the dancers play a dance performance corresponding to the read out dance performance 
data piece; 

an operation device (5) by which the external operation is inputted, for operating said dance performance data 
selecting and reading out device in accordance with the external operation to select and read out said one of 
the dance performance data pieces, so as to change the dance performance of the dancers on the screen; 
a judging device (1) for judging a mutual relation between the dancers in the displayed image; 
a dance perforrnance data selection permitting device (1) for permitting said dance performance data selecting 
and reading out device to select said one of the dance performance data pieces only from among the dance 
performance data pieces each indicatirig such a dance performance that movements of the dancers are inter- 
locked with each other, in case that the judged mutual relation is a predetermined relation; and 
a score calculating device (1) for calculating a game score on the basis of the read out dance performance data 
piece in correspondence with the external operation. 

A video dance game apparatus for displaying an image of at least two dancers on a screen and controlling the 
dancers in the displayed image to play various dance performances in accordance with an external operation to 
thereby offer a dance game, characterized in that said video dance game apparatus comprises: 

an image displaying device (10, 11, 12) having the screen, for displaying the image of the dancers on the 
screen; 

a dance music output device (4., 5) for outputting a music signal indicating a dance music; 

a beat information generating device (1) for generating beat information on the basis of the music signal; 

a dance performance data memory device (2) for storing a plurality of dance performance data pieces each 

indicating respective one of the various dance performances; 

a dance performance data selecting and reading out device (1) for selecting and reading out one of the dance 
performance data pieces stored in said dance performance data memory device; 

an image control device (1. 7. 8, 9) for controlling said image displaying device to change the image of the 
dancers such that the dancers play a dance performance corresponding to the read out dance performance 
data piece; 

an operation device (6) by which the external operation is inputted, for operating said dance performance data 
selecting and reading out device in accordance with the external operation to select and read out said one of 
the dance performance data pieces for at least one of the dancers, so as to change the dance performarice of 

said at least one of the dancers on the screen; 

a read-out control device (1) for controlling said dance performance data selecting and reading out device to 
select and read out another of the dance performance data pieces for another of the dancers in a predeter- 
mined order and at a predetermined timing which are set in advance for said another of the dancers; 
a judging device (1 } for judging a mutual relation between the dancers in the displayed image; 
a dance performance data selection permitting device (1) for permitting said dance performance data selecting 
and reading out device to select said one of the dance performance data pieces only from among the dance 
performance data pieces each indicating such a dance performance that movements of the dancers are inter- 
locked with each other, in case that the judged mutual relation is a predetermined relation; and 
a score calculating device (1) for calculating a game score on the basis of the read out dance performance data 
piece in correspondence with the external operation. 

A video dance game apparatus according to any one of claims 1 to 4, characterized in that said video dance game 
apparatus further comprises: 

a time measuring device (1) for measuring time and restricting a time period, during which the external opera- 
tion is inputted by said operation device (6), to a predetermined time period; and 

a time adjusting device (1) for adjusting the predetermined time period on the basis of the game score calcu- 
lated by said score calculating device (1). 

A video dance game apparatus according to claim 1 or 2, characterized in that said score calculating device (1) cal- 
culates the game score on tiie basis of at least one of a selection order of the dance performance data pieces in 
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correspondence with the external operation, a mutual relation between the successively read dance performance 
data pieces, and a continuity between the successively read dance performance data pieces, in addition to the lime 
lag. 

5 7. A video dance game apparatus according to claim 6. characterized in that said video dance game apparatus fur- 
ther comprises: 

a basic movement data memory device (2) for storing a plurality of basic movement data pieces to change the 
image in various manners respectively such that the dancers perform a predetermined movement in accord- 
to ance with the outputted dance music when the image of the dancers is not changed in correspondence with 
the read dance performance data piece; 

a basic moverxient level setting device (1) for setting a basic movement level on the basis of at least one of the 
read-out timing, the selection order, the mutual relation and the continuity between the successively read 
dance performance data pieces; 
15 a basic movement data selecting and reading out device (1) for selecting and reading out one of the basic 

movement data pieces in accordance with the basic movement level set by said basic movement level setting 
device; and 

a basic movement control device (1 , 7. 8. 9) for controlling said image displaying device (10. 11. 1 2) to change 
the image of the dancers such that the dancers perform the predetermined movement corresponding to the 
20 read out basic movement data piece, when the image of the dancers is not changed in correspondence with 

the read dance performance data piece. 

A video dance game apparatus according to claim 6. characterized in that said video dance game apparatus fur- 
ther comprises a dance music control device (1) for controlling said dance music output device (4. 5) to change the 
music signal outputted therefrom in accordance with at least one of the read-out timing, the selection order, the 
mutual relation and the continuity between the successively read dance performance data pieces. 

9. A video dance game apparatus according to claim 3 or 4. characterized in that: 

30 said judging device (1) judges a mutual positional relation between the dancers in the displayed image, as the 

mutual relation; and 

said score calculating device (1) calculates the game score on the basis of at least one of a read-out timing, 
which is a timing at which the dance performance data piece is read out by said dance performance data 
selecting and reading out device (1). the mutual positional relation, a selection order of the dance performance 
35 data pieces, a mutual relation between the successively read dance performance data pieces, and a continuity 

between the successively read dance performance data pieces, in correspondence with the external operation. 

10. A video dance game apparatus according to claim 9. characterized in that said video dance game apparatus fur- 
ther comprises: 

40 

a basic movement data memory device (2) for storing a plurality of basic movement data pieces to change the 
image in various manners respectively such that the dancers perform a predetermined movement in accord- 
ance with the outputted dance music when the image of the dancers is not changed in correspondence with 
the read dance performance data piece; 
45 . a basic movement level setting device (1) for setting a basic movement level on the basis of at least one of the 
read-out timing, the mutual positional relation, the selection order, the mutual relation and the continuity 
between the successively read dance performance data pieces; 

a basic movement data selecting and reading out device (1) for selecting and reading out one of the basic 
movement data pieces in accordance with the basic movement level set by said basic movement level setting 
so device (1); and 

a basic movement control device (1 , 7. 8, 9) for controlling said image displaying device (1 0. 1 1 . 1 2) to change 
the image of the dancers such that the dancers perform the predetermined movement corresponding to the 
read out basic movement data piece, when the Image of the dancers is not changed-in correspondence with 
the read dance performance data piece. 

55 

11. A video dance game apparatus according to claim 9. characterized in that said video dance game apparatus fur- 
ther comprises a dance music control device (1) for controlling said dance music output device (4, 5) to change the 
music signal outputted therefrom in accordance with at least one of the read-out timing, the mutual positional rela- 
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tion, the selection order, the mutual relation and the continuity between the successively read dance performance 
data pieces. 

12. A video dance game apparatus according to claim 1 or 2, characterized in that said video dance game apparatus 
5 further comprises a dance music control device (1) for controlling said dance music output device (4, 5) to change 

the music signal outputted therefrom in accordance with the read-out timing and the generation timing. 

1 3. A video dance game apparatus according to claim 3 or 4, characterized in that said video dance game apparatus 
further comprises a dance music control device (1) for controlling said dance music output device (4. 5} to change 

10 the music signal outputted therefrom in accordance with the read dance performance data piece. 

14. A video dance^game apparatus according to claim 1 or 2. characterized in that said video dance game apparatus 
further comprises: 

75 a basic movement data memory device (2) for storing a plurality of basic movement data pieces to change the 

image in various manners respectively such that the dancers perform a predetermined movement in accord- 
ance with the outputted dance music when the Image of the dancers is not changed in correspondence with 
the read dance performance data piece; 

a basic movement level setting device (1) for setting a basic movement level on the basis of the time lag 
20 between the read-out timing and the generation timing; 

a basic movement data selecting and reading out device (1) for selecting and reading out one of the basic 
movement data pieces in accordance with the basic movement level set by said basic movement level setting 
device: and 

a basic movement control device (1 , 7, 8. 9) for controlling said image displaying device (10. 1 1 . 12) to change 
25 the image of the dancers such that the dancers perform the predetermined movement corresponding to the 

read out basic movement data piece, when the image of the dancers is not changed in correspondence with 
the read dance performance data piece. 

15. A video dance game apparatus according to claim 3 or 4, characterized in that said video dance game apparatus 
30 further comprises : 

a basic movement data memory device (2) for storing a plurality of basic movement data pieces to change the 
image in various manners respectively such that the dancers perform a predetermined movement in accord- 
ance with the outputted dance music when the image of the dancers is not changed in correspondence with 
35 the read dance performance data piece; 

a basic movement level setting device (1) for setting a basic movement level on the basis of the read dance 
perfornnance data piece; 

a basic movement data selecting and reading out device (1) for selecting and reading out one of the basic 
movement data pieces in accordance with the basic movement level set by said basic movement level setting 
40 device; and 

a basic movement control device (1 . 7, 8, 9) for controlling said image displaying device (10, 1 1 , 12) to change 
the Image of the dancers such that the dancers perform the predetermined movement corresporxiing to the 
read out basic movement data piece, when the image of the dancers is not changed in correspondence with 
the read dance performance data piece. 



45 



16. A video dance game apparatus according to claim 14 or 15, characterized in that: 



said dance periormance data memory device (2) stores a plurality of dance performance data pieces indicating 
dance performances which movements are different from each other with respect to one kind of dance per- 
50 formance; and 

said dance performance data selecting and reading out device (1) selects and reads out one of the dance per- 
formance data pieces stored in said dance performance data memory device in accordance with the basic 
movement level. 

55 17. A video dance game apparatus according to any one of claims 14 to 16. characterized in that said video dance 
game apparatus further comprises a dance music control device (1) for controlling said dance music output device 
(4, 5) to change the music signal outputted therefrom in accordance with the basic movement level. 
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(54) Video dance game apparatus 

(57) A video dance game apparatus for displaying 
an Image of at least two dancers on a screen and con- 
trolling the dancers to play various dance performances 
in accordance with an external operation to thereby 
offer a dance game, is provided with: an image display- 
ing device (10, 11, 12) for displaying the image of the 
dancers: a dance music output device (4. 5) for output- 
ting a music signal Indicating a dance music; a beat 
information generating device (1) for generating beat 
information on the basis of the music signal; a dance 
perfornnance data selecting and reading out device (1) 
for selecting and reading out one of the dance perform- 
ance data pieces stored in a dance performance data 
memory device; an image control device (7, 8, 9) for 
controlling the image displaying device to change the 
image of the dancers such that the dancers play a 
dance performance corresponding to the read out 
dance performance data piece; an operation device (6) 
by which the external operation is inputted, for operating 
the dance performance data selecting and reading out 
device in accordance with the external operation to 
select and read out the one of the dance performance 
data pieces; and a score calculating device (1) for calcu- 
lating a game score on the t)asis of a time lag between 
a read-out timing of the dance performance data piece 
and a generation tinning of the beat information. 
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(54) Video dance game apparatus 

(57) A video dance game apparatus for displaying 
an image of at least two dancers on a screen and con- 
trolling the dancers to play various dance performances 
in accordance with an externa! operation to thereby 
offer a dance game, is provided with: an image display- 
ing device (10. 11. 12) for displaying the image of the 
dancers; a dance music output device (4. 5) for output- 
ling a music signal indicating a dance music; a beat 
information generating device (1) for generating beat 
information oh the basis of the music signal; a dance 
performance data selecting and reading out device (1) 
for selecting and reading out one of the dance perform- 
ance data pieces stored In a dance performance data 
memory device; an image control device (7. 8. 9) for 
controlling the image displaying device to change the 
image of the dancers such that the dancers play a 
dance performance corresponding to the read out 
dance performance data piece: an operation device (6) 
by which the external operation is inputted, for operating 
the dance performance data selecting and reading out 
device in accordance with the external operation to 
select and read out the one of the dance performance 
data pieces; and a score calcuFating device (1) for calcu- 
lating a game score on the basis of a time lag between 
a read-out timing of the dance performance data piece 
and a generation timing of the beat information. 
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(54) Music action game machine, performance operation instructing system for music action 
game and storage device readable by computer 



(57) The music action game machine comprises: a 
main body; an operation input device disposed on a front 
side of the main body so as to be adjacent to hands of 
a player facing the front side of the main body, the op- 
eration input device having a plurality of operation mem- 
bers; a storage device for storing data of a musical com- 
position and data of a performance procedure associat- 
ed with the musical composition; a rnusic play device for 
playing the musical composition based on the data 
stored in the storage device; an operation instructing de- 
vice tor giving the player a visual instruction to operate 
the operation members in accordance with progress of 
a play of the musical composition based on the data 
stored in the storage device; an effect producing device 
for producing a performance effect in response to a per- 
formance operation performed by the player to each of 
the operation members; an estimation device for esti- 
mating the performance operation of the player based 
on a relationship between the performance procedure 
defined by the data stored in the storage device and the 
performance operation of the player; and an estimation 
informing device for informing the player' of an estima- 
tion result determined by the estirriation device. There- 
fore, the player can enjoy the simulation of the perform- 
ance of the music through the operation of the operation 
members. 
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Description 

[0001] The present Invention relates to a music action 
game machine whereby a player can enjoy performing 
operations in time with music, an operation instructing 
system suitable for the music action game machine and 
the storage device readable by a computer. 
[0002] Recently, disc jockeys who perform operations 
to remix music with sound effects become popular main- 
ly in the younger generation. However, there are no 
game machines directed to provide the player with 
pleasure of simulating the disc jockeys. 
[0003] One of objects of the present invention is to 
provide a music action game machine capable of pro- 
viding the player with pleasure of performing operations 
in time with music. 

[0004] In order to attain the.above object, there is pro- 
vided a music action game machine comprising: 

a main body; 

I an operation input device disposed on a front side 
of the main body so as to be adjacent to hands of a 
player facing the front side of the main body, the 
operation input device having a plurality of opera- 
tion members; 

a storage device for storing data of a musical com- 
position and data of a performance procedure as- 
sociated with the musical composition; 
a music play device for playing the musical compo- 
sition based on the data stored in the storage de- 
vice; 

an operation Instructing device for giving the player 
a visual Instruction to operate the operation mem- 
bers in accordance with progress of a play of the 
musical composition based on the data stored In the 
storage device; 

an effect producing device for producing a perform- 
ance effect in response to a performance operation 
performed by the player to each of the operation 
members; 

an estimation device tor estimating the perform- 
ance operation of the player based on a relationship 
between the performance procedure defined by the 
data stored in the storage device and the perform- 
ance operation of the player; and 
an estimation informing device for informing the 
player of an estimation result determined by the es- 
timation device. 

[0005] According to the above-mentioned game ma- 
chine, when the player operates at least pne of the op- 
eration members in association with the music, the per- 
formance effect corresponding to the operation is mixed 
on the music. Therefore, the player can take pleasure 
in performing the music. Since the data of the perform- 
ance procedure is stored in advance and correct timing 
to operate each operation member is indicated to the 
player through the operation Instructing device in a vis- 



ual manner, the player only has to operate the operation 
members in accordance with the instruction given from 
the game machine. Therefore, even if the player who is 
not skilled in performance of the music can enjoy the 

5 game easily Since the operation of the player is esti- 
mated by the game machine and the result thereof is 
informed to the player, it is possible to enhance the com- 
petitive character of the game by changing difficulty of 
the game variously. 

10 [0006] The operation input device may comprise a 
disk-shaped operation member as one of the operation 
members, and the disk-shaped operation member may 
be operable so as to be turned about an axis thereof. 
[0007] The effect producing device may produce a 

?5 scratch sound effect as the performance effect in re- 
sponse to a turning operation of the disk-shaped oper- 
ation member, and said scratch sound effect may be 
similar to an actual scratch sound produced by irregu- 
larly turning a phonograph record disk with keeping con- 

20 lacl between the phonograph record disk and a stylus 
of a phonograph player 

[0008] The operation instructing device may com- 
prise: an indicator disposed on the front side of the main 
body and provided with at least one track extending in 

2S a predetermined direction; and a mark indicating device 
capable of indicating index marks, each of which Is pro- 
vided for Indicating operation timing of each of the op- 
eration members, in such a manner that each of the in- 
dex marks moves along the track and then reaches to 

30 a fixed operation position defined in the track when the 
operation timing associated with each of the index 
marks comes. * 

[0009] The mark indicating device m.ay change a 
length of each of the index marks in said predetermined 
35 direction in accordance with a length of an operation 
continuation time during which each of the operation 
members must be operated. 

[0010] In this case, it is possible to request more var- 
ious performance procedure in comparison with in the 
40 case that only the operation timing is indicated to the 
player. This embodiment is more effective when com- 
bined with the above-mentioned disk-shape operation 
member. 

[001 1 ] A plurality of tracks may be provided as said at 
45 least one track, and said tracks may be arranged side 
by side with each other so as to accord with an arrange- 
ment of the operation members. In this case, the oper- 
ation members corresponds to respective tracks differ- 
ent from each other 
so [0012] An illumination device may be provided on the 
front side of the main body, and the effect producing de- 
vice may control an illumination of the illumination de- 
vice in response to the performance operation of the 
player 

55 [0013] A loud speaker may be provided on the front 
side of the main body, and the Illumination device may 
comprise a loud speaker illuminator surrounding an out- 
er periphery of the bud speaker 
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[001 4] A relationship between each of the operation 
members and the performance effect to be produced in 
response to the operation thereto may be changed in 
accordance with the progress of the play of the musical 
composition. 

[0015] The estimation device may estimate the per- 
formance operation each time the performance opera- 
tion is actually performed during the play of the musical 
composition, and the estimation informing device may 
inform the estimation result each time the estimation de- 
vice determines the estimation result. 
[0016] The estimation device may estimate the per- 
formance operation with referring to a relationship be- 
tween the performance procedure stored in the storage 
device and a length of an operation continuation time 
during which each of the operation members must be 
operated 

[0017] The main body may have a plurality of operat- 
ing sections, each of which is provided with the opera- 
tion input device; the estimation device may estimate 
the performance operation separately for each of the op- 
"erating sections; and the estimation informing device 
may inform the estimation result separately for each of 
the operating sections. 

[0018] The estimation device may calculate a score 
in accordance with superiority of the performance oper- 
ation, and the estimation informing device may inform 
the calculated score. 

[0019] The data storage device may store a plurality 
of data sets, each of which includes the data of the mu- 
sical composition and the data of the performance pro- 
cedure: and said game machine may further comprise 
a stage progress management device for controlling 
progress of a game in such a manner that when the es- 
timation device gives a predetermined level of estima- 
tion with respect to the performance operation in one 
stage in which the musical playing device plays the mu- 
sical composition based on one of the data sets, the 
game is allowed to progress to a next stage in which the 
music play device plays the musical composition and 
the instructing device instructs the performance opera- 
tion based on another one of the data sets. 
[0020] The effect producing device may produce a re- 
action effect as one type of the performance effect when 
the game reaches to an end of said one stage, and the 
reaction effect may be changed in accordance with the 
estrmation result at the end of said one stage. 
[0021] The operation instructing device may make a 
decision as to whether or not operation timing of each 
of the operation members comes, and instruct the per- 
formance operation to the player in a different visual 
manner in accordance with a result of safd decision. In 
this case, the operation timing may have a certain width 
of time. 

[0022] The estimation device may make a decision as 
to whether or not operation timing of each of the opera- 
tion members comes, and estimate the performance op- 
eration when it is judged that the operation timing 



comes. 

[0023] The operation instructing device may make a 
decision as to whether or not operation timing of each 
of the operation members comes, and change a stand- 

5 ard. with which the performance operation is estimated, 
in accordance with a result of said decision. 
[0024] The estimation device may estimate the per- 
formance operation based on a difference between tim- 
ing of the performance operation defined by the data of 

10 the performance procedure and timing at which the play- 
er actually performed the performance operation. 
[0025] The effect producing device may produce ef- 
fects different from each other in response to respective 
operations of the operation memberS: and each of the 

75 effects corresponds to the performance effect. 

[0026] The effect producing device may produce a re- 
action effect as one type of the performance effect each 
time the estimation device determines the estimation re- 
sult, and the reaction effect may by changed in accord- 

20 ance with the estimation result. 

[0027^ The effect producing device may produce a 
predeterrhined sound effect so as to remix sounds of the 
musical composition with the sound effect in accord- 
ance with the performance operation. 

25 [0028] The storage device may store a data set in- 
cluding the data of the musical composition and a plu- 
rality of operation data sections associated with the mu- 
sical composition, each of the operation data sections 
corresponding to the data of the performance proce- 

30 dure; at least one of the operation data sections may be 
prepared so as to make difficulty with respect to the per- 
formance procedure defined thereby easier than that 
defined by another one of the operation data sections; 
and the operation instructing device may select any one 

35 of the operatbn data sections and instructs the player 
to operate the operation members based on said select- 
ed one of the data sections. 

[0029] In this case , it is possible to present selectively 
one of the plurality of the performance procedures to the 
40 player in accordance with the skill of the player There- 
fore, the player can play the game with appropriate dif- 
ficulty. 

[0030] The performance procedure defined by said at 
least one of the operation data sections may be'sub- 

45 stantialiy equal to a procedure in which a part of opera- 
tions to the operation members is omitted in comparison 
with the performance procedure defined by said another 
one of the operation data sections. 
[0031] The storage device may store automatic play 

50 data for producing the performance effect correspond- 
ing to each of the operations which are omitted in com- 
parison with the performance procedure defined by said 
another one of the operation data sections; and the 
game machine may further comprise an automatic play 

55 device capable of producing the performance effect 
based on the automatic play data independently of the 
performance operation of the player 
[0032] The music action game machine may further 
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comprise an operational relationship control device tor 
changing a relationship between operations of the op- 
eration members defined by the data of the performance 
procedure and the operation members which arfe des- 
ignated to be operated through the instruction of the op- 
eration instructing device with respect to the same mu- 
sical composition. 

[0033] The operation instructing device may com- 
prise: 

an indicator disposed on the front side of the main 
body, at lease one part of the indicator being pro- 
vided with a plurality of tracks which extend in a pre- 
determined direction and which correspond to the 
operation members, respectively; and 
a mark indicating device capable of indicating index 
marks, 

each of the index marks may correspond to each 
operation timing of the operation members which 
will come in a certain period from a present to future 
in a game, and the Index marks may be disposed 
in the tracks so as to be arranged from a predeter- 
mined position toward one side of the predeter- 
mined direction in accordance with time order ther- 
ebetween. 

[0034] The mark indicating device may be capable of 
changing an indication manner of the index marks be- 
tween a first mode and a second mode, the first mode 
may be prepared to set a relationship between the index 
marks and the tracks equal to a relationship between 
the operation mem6ers and the operation timing defined 
by the data of the performance procedure, and a second 
mode may be prepared to set the relationship between 
the index marks and the tracks in a different manner 
from that of the first mode. 

[0035] The estimation device may estimate the per- 
formance operation with interpreting that a relationship 
between the operation timing of each of the operation 
members defined by the data of the performance pro- 
cedure and the performance operation to each of the 
operation members is changed in accordance with the 
relationship between the index marks and the tracks 
when in the second mode. 

[0036] The mark indicating device may be capable of 
selecting a third mode in which the index marks are hid- 
den in a specific range which extends from the prede- 
termined position in the tracks toward said one side of 
the predetermined direction. 

[0037] The main body may have a plurality of operat- 
ing sections, each of which is provided with the opera- 
tion input device; the operation instructing device may 
be capable of instructing the same performance proce- 
dure to each of the operating sections with respect to 
the same musical composition; the estimation device 
may estimate the performance operation separately for 
each of the operating sections; and the estimation in- 
forming device may inform the estimation result sepa- 



rately for each of the operating sections. 
[0038] The main body may be provided with a plurality 
of operating sections arranged in a lateral direction 
thereof, each of the operating section being provided 

5 with the operation input device; the front side of the main 
body may be provided with a display device for display- 
ing a game image; the operation instructing device may 
be capable of changing a display manner of the display 
device between a first display mode and a second dis- 

?o play mode; the first display mode may be prepared to 
display images for indicating timing of the performance 
operation on a screen of the display device with leaving 
a space between each of the images in the lateral direc- 
tion in accordance with an arrangement of the operating 

IS sections; and the second display mode may be pre- 
pared to display the images for indicating timing in such 
a manner that a space therebetween is less than that in 
the first display mode. 

[0039] Each of the data of the musical composition 
20 and the data of the performance effect may be stored in 
the storage device as PCM data. 

[0040] According to another aspect of the present in- 
vention, there is provided a music action game machine 
comprising: 

2S 

a main body; 

an operation input device disposed on a front side 
- of the main body so as to be adjacent to hands of a 
playr^r facing the front side of the main body, the 
30 operation input device having a plurality of opera- 
tion members: 

a storage device for storing data of a performance 
procedure associated with a predetermined musi- 
cal composition; 

3S an operation instructing device for giving the player 
a visual instruction to operate the operation mem- 
bers based on the data of the performance proce- 
dure stored in the storage device; 
an effect producing device for producing a perform- 

40 ance effect in response to a performance operation 
of the player to each of the operation members; 
an estimation device for estimating the perform- 
ance operation of the player based on a relationship 
between the performance procedure defined by the 

45 data stored in the storage device and the perform- 
ance operation of the player; and 
an estimation informing device for informing the 
player of an estimation result determined by the es- 
timation device. 

so 

[0041] According to still another aspect of the present 
invention, there is provided a music action game ma- 
chine comprising: 

ss an operation input device having a plurality of the 
operation members and capable of issuing opera- 
tion input signals different from each other in ac- 
cordance with each of operations to the operation 
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members; 

a storage device tor storing data of a musical com- 
position, data of a performance procedure, with re- 
spect to each of the operation members of the op- 
eration input device, and data of sound effects cor- 
responding to each of the operation members; 
a music play device for playing the musical compo- 
sition based on the data of the musical composition 
stored in the storage device; 

an performance procedure presenting device for 
presenting the player with the performance proce- 
dure In a vtsual manner in association with a play 
of the musical composition based on the data of the 
performance procedure stored in the storage de- 
vice.; 

a sound effect producing device for producing the 
sound effects based on the operation input signals 
issued from the operation input device and the data 
of the sound effects stored in the storage device; 
an estimation device for estimating operations of 
the player based on the operation input signals is- 
sued from the operation input device and the data 
of the performance procedure stored in the storage 
device; and 

an estimation informing device for informing an es- 
timation result determined by the estimation device. 

[0042] Another one of objects of the present invention 
is to provide an operation instructing system suitable for 
instructing an operation of a music action game ma- 
chine. 

[0043] In order to attain the above object, there is pro- 
vided a performance operation instructing system, 
which instructs a player to operate at least one operation 
member at a predetermined timing in association with 
progress of a play of a predetermined musical compo- 
sition, comprising: 

an indicator provided with at least one track extend- 
ing in a predetermined direction; and 
a mark indicating device capable of indicating index 
marks, each of which is provided for indicating op- 
eration timing of the operation member, in such a 
manner that each of the index marks moves along 
the track and then reaches to a fixed operation po- 
sition defined in the track when the operation timing 
associated with each of the index marks comes. 

[0044] According to the above-mentioned operation 
instructing system, it is possible to provide a music ac- 
tion game machine with a simple operation system such 
that the player may operate the operatibn member at 
timin g when the index mark corresponding the operation 
member reaches to the fixed performance operation po- 
sition. Therefore, the player may easily become accus- 
tomed to the operation of the game. Since the perform- 
ance operation position is fixed, the player may concen- 
trate on the game with fixing his eyes on a certain posi- 



tion In the indicator. It Is not necessary for the player to 
move his eyes to follow each movement of each index 
mark. 

[0045] The mark indicating device may change a 
5 length of each of the index marks in said predetermined 
direction in accordance with a length of an operation 
continuation time during which the operation member 
must be operated. 

[0046] A plurality of operation members may be pro- 
10 vided as said at least one operation member, and a plu- 
rality of tracks may be provided as said at least one 
track, said tracks being arranged side by side with each 
other so as to accord with an arrangement of the oper- 
ation members. 
15 [0047] Note that the instructing system of the present 
invention can be used in various types of the music 
game machines besides the game machine mentioned 
above. 

[0048] Still another objects of the present invention is 
20 [o provide a storage device which is readable by a com- 
puter and which stores a program and data necessary 
for performing a game in a music game machine. 
[0049] In order to attain the above object, there Is pro- 
vided a storage device readable by a computer which 
25 stores data defining a procedure for operating operation 
members provided in a game system in association with 
a predetermined music, and a program for instructing a 
player to operate the operation members through a 
screen of a display device provided in the game system. 
30 and said program is prepared for causing the computer 
to execute steps of: 

displaying an image of an instruction on the screen 
of the display device to operate the operation mem- 
35 bers based on the data defining the procedure; 

producing a performance effect in response to an 
operation of the operation members performed by 
the player; 

estimating the operation of the operation members 
40 based on a relationship between the data defining 
the procedure and the operation performed by the 
player; and 

informing a result of said estimating step to the play- 
er. 

45 

[0050] According to another aspect of the present in- 
vention, there is provided a storage device readable by 
a computer which stores data deHning a procedure for 
operating operation members provided in a game sys- 

50 tem in association with a predetermined music, data of 
sound effects to be produced in association with oper- 
ation input signals issued from the operation members 
in response to operations thereof, and a program for in- 
structing a player to operate the operation members 

55 through a screen of a display device provided in the 
game system, and said program Is prepared for causing 
the computer to execute steps of: 
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displaying an image of an instruction on the screen 
of the display device to operate the operation mem- 
bers based on the data defining the procedure; 
producing at least one of the sound effects based 
on the operation input signals issued from the op- 
eration members and the data of the sound effects; 
estimating operations performed by the player 
based on the operation input signals issued from 
the operation members and the data defining the 
procedure; and 

informing a result of said estimating step to the play- 
er. ^ - 

[0051] According to still another aspect of the present 
invention, there Is provided a storage device readable 
by a computer which stores a program for giving a player 
an instruction to operate at least one operation member 
provided in a game system at a predetermined timing in 
association with progress of a play of a predetermined 
musical composition, said instruction Is given through a 
screen of a display device provided in the game system, 
and said program is prepared for causing the computer 
to execute steps of: 

displaying an indicator on the screen of the display 

device, said indicator being provided with at least 
one track extending in a predetermined direction; 
and 

indicating index marks, each of which is provided 
for Indicating operation timing of the operation 
member, in such a manner that each of the index 
marks moves ^long the track and then reaches to 
a fixed operation position defined in the track when 
the operation timing associated with each of the in- 
dex marks comes. 

[0052] In the present invention, the storage device 
may include a magnetic storage device such as a hard 
disk drive or a floppy disk, an optical or a magneto-op- 
tical storage device such as a CD-ROM, a semiconduc- 
tor storage device suchas a RAM or a ROM, or the other 
various types of the storage devices. The performance 
operation Includes an action to complete the music by 
playing one part of the music by the player as well as 
an action to remix sounds of a complete music compo- 
sition with an effect of sound or light. 
[0053] Still further objects, features and other aspect 
of the present Invention will be understood from the fol- 
lowing detailed description of the preferred embodi- 
ments of the present invention with reference to the ac- 
companying drawings. 

FIG. 1 is a perspective view of a music action game 
machine in accordance with one embodiment of the 
present invention; 

FIG. 2 is a vertical sectional view of the game ma- 
chine of FIG. 1 . which is taken along a front and rear 
side direction thereof; 



FIG. 3 is an enlarged view showing a keyboard input 
unit provided in the game machine of FIG. 1; 
FIG. 4 is a sectional view of a turntable input unit 
provided in the game machine of FIG. 1: 

5 FIGS. 5A and 5B are views showing details of a de- 

tection mechanism provided in the turntable input 
unit of FIG. 4; namely. FIG. 5 A is a plan view of a 
slit disk connected with a lower end of a rotary shaft 
and FIG- 5B is an enlarged view of a portion Vb in 

10 FIG. 5A; 

FIG. 6 is a block diagram showing a control system 
of the game machine of FIG. 1 ; 
FIG . 7 is a view showing a relationship between mu- 
sic performance data and a performance procedure 

IS corresponding thereto; 

FIG. 8 is a view showing an indication table for de- 
fining a relationship between operation members 
and a sound effect of the game machine of FIG. 1 
for each phrase of the musical composition to be 

20 played; 

FIG. 9 is a diagram illustrating an example of a 
game image displayed on a screen of the game ma- 
chine during game play; 

FIG. 10 is a diagram illustrating an indicator dis- 
25 played In the game image of FIG. 9 for indicating 

timing of performance operation to the player, 
FIG. 11 is a flow diagram showing an example of a 
stage arrangement in the game machine of FIG. 1 ; 
FIG. 12 is a flow chart showing a process for one 
30 stage executed by a CPU of FIG. 6; 

FIGS. 13A to 13C are diagrams showing a config- 
uration of a data set for a musical composition X 
stored in an auxiliary storage device of FIG. 6 in ac- 
cordance with another embodiment of the present 
35 invention; 

FIG. 14 is a diagram showing a configuration of the 
performance data of FIG. 13; 

FIG. 15 is a diagram showing a manner for loading 
operation timing data into a RAfV/1; 
40 FIG. 16 is a flow chart showing a process for one 
stage executed by a CPU of FIG. 6 in the other em- 
bodiment; 

FIG. 17 is a flow chart following FIG. 16; 
FIG. 18 is a diagram Illustrating display examples 
45 of the Indicator in a normal mode and an easy mode 
for reducing operational difficulty; 
FIG. 19 is a diagram illustrating display examples 
of the indicator in a random and a non -random 
mode; 

so FIG. 20 is a diagram illustrating display examples 

of the indicator in a hidden mode and a non-hidden 

mode; 

FIG. 21 is a view showing a modification of perform- 
ance operation sections; 
ss FIG. 22 is a plan view showing a slide type volume 

switch prepared for the performance operation; and 
FIGS. 23A and 23B are diagrams showing an em- 
bodiment in which display positions of the Indicators 
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on the screen are changeable between left and right 
side ends of the screen and the center thereof. 

[0054] The preferred embodiment of the present in- 
vention will now be explained below with reference to 
the attached drawings. 

[0055] FIG. 1 shows an appearance of a music action 
game machine according to the present invention and 
FIG. 2 shows an internal structure thereof. The game 
machine 1 is constructed by attaching various parts on 
or in the main body 2. The main body 2 is provided with 
a main housing 3 and a top box 4 mounted on the top 
of the main housing 3. At the upper portion of the main 
housing 3, there is provided a display portion 5. The dis- 
play portion 5 is provided with a CRT monitor 6, and both 
sides o\ the monitor 6 are provided illumination lamps 
7 A 7A so as to extend vertically. Below the display por- 
tion 5 mere is provided loud speakers 8A...8A. The 
mnin housing 3 is provided below the loud speakers 8A 
wilt) ci Icrward projecting portion 9, and the front side of 
the piojecting portion 9 is provided with a loud speaker 
"units 80 cB 

[0056] The projecting portion 9 is provided on the top 
thercol with a control panel 10. The control panel 10 is 
positioned m the vertical direction so as to be adjacent 
to hands of a player (or players) when the player stands 
in front of the game machine 1 with facing a screen of 
the monitor 6. The control panel 10 is provided with a 
coin insertion slot 1 1 located at the center thereof, a per- 
formance operating section 12A for the first player lo- 
cated at the left side of the coin insertion slot 11, and a 
performance operating section 1 28 for the second play- 
er located at the right side of the coin insertion slot 11. 
Each of the operating sections 1 2A and 1 2B is provided 
with an operation input device comprising a keyboard 
input unit 13 and a turntable input unit 14. 
[0057] The keyboard input unit 1 3 is provided with five 
keys ISA, 158, ISC, 1SD. and 15E consisted of push 
button switches. The arrangement of the keys 1 SA to 
1 5E is similar to the key arrangement of musical instru- 
ments. Namely, the three keys ISA, 15C and 15E are 
juxtaposed on a side near the player while the two keys 
15B and 15D are juxtaposed behind thereof. Also, the 
rear side keys 15B and 15D are aligned with boundary 
positions between the front side keys 15A, 15C, and 
15E. Hereinafter, each of the operating sections 12A 
and 128 will be denoted as the operating section 12. if 
it is not necessary to distinguish the two sections 12A 
and 12B from each other, and each of the keys ISA to 
1 5E may be denoted as the key 15. 
[0058] In FIG. 1, the top of each key 15 is illustrated 
as a flat plane, however, as shown in FIGT, 3, each key 
1 5 may be provided with a projecting portion 1 5p on one 
side far from the player. Each key 1 5 is provided with an 
indicating lamp 17 such as an LED. Instead of the indi- 
cating lamp 17, an iliuminant such as an electric bulb or 
the like may be provided inside the key 15 to emit light 
from the key IS itself. 



[0059] FIG. 4 shows a detail of the turntable input unit 
14. The turntable input unit 14 comprises a base 20 
mounted on the control panel 10. a rotary shaft 22 sup- 
ported on the base 20 through a bearing 21 so as to 

5 rotate about an axis thereof, and a slide disk 23 as a 
disk-shaped operation member fitted into a circular re- 
cess 20a of the base 20 and connected with the upper 
end 22a of the rotary shaft 22 so as to be rotatable there- 
with. The slide disk 23 is in imitation of a phonograph 

10 record disk, and the upper surface 23a is exposed out- 
side of the control panel 1 0. The player can enjoy a sim- 
ulation of scratch play by turning the slide disk 23 in a 
clockwise or counter-clockwise direction with putting fin- 
gers on the upper surface 23a. The scratch play is 

IS known as an action to produce various scratch sounds 
by manually and irregularly turning the phonograph 
record disk with keeping the contact between the record 
disk and a stylus of a phonograph player. 
[0060] Between the slide disk 23 and the bottom sur- 

20 face of the circular recess 20a of the base 20, there is 
provided with a felt sheet 24 as means for giving friction 
resistance against the turning movement of the slide 
disk 23, The felt sheet 24 is formed in a disk-shape and 
is smaller than the slide disk 23. The felt sheet 24 may 

25 have at least one through hole to maintain the friction 
resistance in a proper degree. 

[0061] The turntable input unit 14 is provided with a 
detection mechanism 28 for detecting information with 
respect to an operation of the slide disk 23, such as a 

30 turning speed, a turning direction or the like. The detec- 
tion mechanism 28 comprises a slit disk 25 fixed to the 
lower end of the rotary shaft 22 by using screws 26.. .26 
so as to be rotatable therewith, and a pair of sensors 
27A and 27B provided on an outer periphery of the slit 

35 disk 25. As shown in FIG. 5 A, on the outer periphery of 
the slit disk 25. there are provided a plurality of slits 
25a.. .25a with leaving a certain pitch angle P therebe- 
tween in a circumferential direction of the slit disk 25. 
[0062] Each of the sensors 27A and 27B is a photo- 

40 interrupt-type sensor in which a predetermined beam of 
light is emitted from an emitter 27p toward a receiver 
.27q and the receiver 27q issues a predetermined signal 
which changes between ON and OFF in accordance 
with the intensity of the light received therein. As shown 

45 in FIG. 5B, the sensors 27A and 27B are arranged in 
such a manner that when a center line A of the sensor 
27A is positioned in the middle of the two slits 25a. 25a 
which are adjacent to each other, a center line B of the 
other sensor 27B is deviated from a center line C of the 

50 nearest slit 25a by P/4 i.e. one-fourth of the pitch angle 
P in the circumferential direction. The deviation between 
the center lines B and C is not limited to P/4; namely, 
the deviation may be set to various values except P/2. 
[0063] In the above-mentioned turntable input unit 1 4, 

55 when the slide disk 23 is turned, the slit disk 25 also 
turns therewith, and the signals issued from the sensors 
27A and 27B cyclically change in a predetermined cycle 
depending on the turning speed of the slit disk 25. 
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Therefore, it is possible to calculate the turning speed 
of the slide disk 23 by detecting the cycle of the signals. 
Also, it is possible to distinguish the turning direction of 
the slide disk 23 on the basis of a phase difference be- 
tween the signals issued from the sensors 27A and 27B. 
in other words, the degree of deviation between the tim- 
ing at which the signals changes between ON and OFF. 
[0054] As shown in FIGS. 1 and 2. the control panel 
10 is provided at the center thereof with a supplemental 
input device 30. The supplemental input device 30 com- 
prises three push button switches 31 A, 31 B and 31 C 
disposed in front ot the coin insertion slot 11 so as to be 
aligned in the front-and-rear side direction. Also, as 
shown in FIG. 2, the main body 2 is provided therein 
with a coin control device 35. A coin inserted into the 
slot 11 falls into the control device 35 through a chute 
36. The control device 35 examines whether the insert- 
ed coin is acceptable or not. and feeds the coin which 
is judged to be acceptable to a stock container 37 while 
feeding the coin which is judged not to be acceptable to 
a coin return port 38 (refer to FIG. 1). 
[0065] As shown in FIG. 1 . the top box 4 of the main 
body 2 is provided at the center on the front side thereof 
with a decoration panel 40, and both sides thereof are 
provided loud speakers 8C...8C. Each loud speaker 8C 
is installed in a downward oblique manner that the top 
side thereof is located forward from the lower side there- 
of to emphasize existence thereof to the player. On the 
periphery of each loud speaker SC. there is provided a 
illumination lamp 7B of a tube-type which is circularly 
curved so as to surround the loud speaker 8C. 
[0066] FIG. 6 shows a structure of a control system 
provided in the game machine 1. As is apparent from 
FIG. 6, the game machine 1 comprises a CPU 50 mainly 
consisted of a microprocessor to perform various calcu- 
lations and operation controls necessary for progress of 
the game, an image processing unit 51 for displaying 
desirable images on the screen of the monitor 6 in ac- 
cordance with requests from the CPU 50. a sound 
processing unit 52 for producing sounds through the 
loud speakers 8A, 8B and 8C in accordance with re- 
quests from the CPU 50, an illumination control unit 53 
for turning the illumination lamps 7A and 7B ON and 
OFF in accordance with requests from the CPU 50, and 
a storage means consisted of a RAM 54, a ROM 55 and 
an auxiliary storage device 56. The auxiliary storage de- 
vice 56 is preferably a hard disk drive with a magnetic 
storage media having a capacity far greater than that of 
each of the RAM 54 and the ROM 55. The sound 
processing unit 52 is capable of receiving PCM (Pulse 
Code Modulation) or ADPCM (Adaptive Differential 
Pulse Code Modulation) data stored in the auxiliary stor- 
age device 56 in response to requests from the CPU 50 
and producing sounds through the loud speakers 8 A, 
8B and 8C in association with the data. 
[0067] Each of the above mentioned units 51 to 53. 
the RAM 54, the ROM 55 and the auxiliary storage de- 
vice 56 is electrically connected with the CPU 50 



through a bus 57. Also, the CPU 50 is electrically con- 
nected with the keyboard input unit 13, the turntable in- 
put unit 14, the supplemental input device 30 and the 
coin control device 35 through the bus 57. 

5 [0068] The ROM 55 stores a program and data nec- 
essary for 'controlling a basic operation of the game ma- 
chine 1 during the start-up thereof or the like. The aux- 
iliary storage device 56 stores music data for reproduc- 
ing various musical compositions as BGM (Sack 

10 Ground Music), and performance data for defining a pro- 
cedure of an performance "operation to be performed 
with respect to each musical composition. These data 
are loaded into a predetermined area in the RAM 54 in 
accordance with requests from the CPU 50. The music 

15 data is formed, for example, as PCM data or ADPCM 
data. 

[0069] FIGS. 7 and 8 show an example of a relation- 
ship between the music data stored in the auxiliary stor- 
age device 56 and a performance procedure corre- 

2o sponding thereto. In these figures, the operation mem- 
bers are represented as keys A to E, a turntable and 
adiib keys A to C. The keys A to E correspond to the 
keys ISA to 15E in FIG. ^, respectively. A turntable cor- 
responds to the slide disk 23 in FIG. 1. Further. adIib 

25 keys A, B and C in FIG. 8 correspond to the push button 
switches 31 A to 31 C in the supplemental input device 
30, respectively. 

[0070] As shown in a block diagram of FIG. 7, the mu- 
sical composition X comprises a plurality of phrases F1 , 

30 F2. F3, ... . The performance procedure with respect to 
the composition X. for example in the phrase F1 , is pre- 
pared as illustrated in a time chart of FIG. 7. In the time 
chart, each rectangular portion, i.e. hatched portion rep- 
resents a time period during which each operation mem- 

35 ber is to be operated, the left end of the rectangular por- 
tion represents a start time of the operation, the right 
side thereof represents an end time of the operation, 
and a length of the rectangular portion corresponds to 
a length of time during which the operation must be con- 

40 tinued. The auxiliary storage device 56 stores numerical 
data of the start time and the end time for each of the 
keys A to E and the turntable coded in accordance with 
the time chart in FIG. 7. • 

[0071] The storage device 56 also stores data of var- 
45 ious sound effects to be produced through the loud 
speakers in response to the operation to each of the 
keys A to E and the adIib keys A to C. In order to change 
the sound effects every phrase of the musical composi- 
tion, the storage device 56 stores a data table TB (illus- 
so trated in FIG. 8) in association with the music data. In 
the data table TB, the sound effect to be produced in 
each of the phrases F1, F2, F3 ... is assigned to each 
of the keys A to E and the adIib keys A to C. For example 
in the phrase F1. the sound effects 1 to 5 are assigned 
ss to the keys A to E and the sound effects 6 to 8 are as- 
signed to the adIib keys A to C, respect'rvely As men- 
tioned above, the data for producing the sound effects 
1. 2, ... are also stored in the storage device 56. Note 
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that, it is possible to use various sounds considered to 
be proper for performing the music, such as sounds of 
musical instruments, sounds of voice, sounds of hand- 
claps or the like. The data of sound effects may be 
formed as PCM or ADPCfVI data. 
[0072] Since the turntable input device 1 4 is provided 
to give the player with the pleasure of the simulation of 
the scratch play, it Is preferable to assign a scratch 
sound effect to the operation of the slide disk 23. The 
scratch sound effect should be tuned so as to be similar 
to the real scratch sound which is produced by perform- 
ing the scratch play with using the real phonograph 
record disk and the phonograph player. It is also prefer- 
able to change the scratch sound effect in accordance 
with the turning direction of the slide disk 23 or the ro- 
tation speed of the slide disk 23. 
[0073] Since the two operating sections 1 2A and 1 2B 
are provided in the game machine 1 , two sets of the per- 
formance data are prepared for the operating sections 
12A and T2B and stored into the storage device 56. If 
the two sets of the performance data are different from 
each other, It is possible to provide the player (or play- 
ers) with a game play like a musical dialogue or duet, 
and to producing different sound effects in response to 
the performance operations to each operating section 
1 2. Therefore, it is possible for the player (or players) to 
play various performances in contrast with the case in 
which only one of the operating sections 12 is used, 
thereby increasing interest of the game. 
[0074] FIG. 9 shows a game image displayed on the 
screen of the monitor 6 through the image processing 
device 51 during the game play. The game image com- 
prises a main display portion 60 disposed at a center 
thereof, a groove gauge 61 disposed above the main 
display portion 60, and a pair of score frames 62A and 
62B disposed below the main display portion 60. The 
main display portion 60 is a portion in which a video im- 
age or the like is displayed to heat up the atmosphere 
of the game. For example, dance scenes matching the 
music played through the game machine 1 are dis- 
played. 

[0075] The groove gauge 61 is provided with a gauge 
frame 61a and a gauge bar 61b capable of expanding 
and contracting in accordance with superiority of -the 
game play with the left end of the frame 61a being as a 
reference. Note that, the gauge bar 61 b is illustrated with 
hatching in FIG. 9. The score frame 62A is provided for 
displaying therein a game score corresponding to the 
performance operation to the performance operating 
section 12A, while the score frame 62B is provided for 
displaying therein a game score corresponding to the 
performance operation to the performance operating 
section 12B. 

[0076] The garne image is also provided at the left and 
right side thereof with indicators 65A and 65B. Each of 
the indicators 65A ahd 65B has the same configuration. 
Hereinafter, each indicator may be denoted as the indi- 
cator 65 if it is not necessary to distinguish the indicators 



65 A and 65B from each other The indicator 65 is pro- 
vided with five rows of key tracks 66A, 66B. 66C. 66D 
and 66E each extending in the vertical direction, and a 
turntable track 67. The key tracks 66A to 66E are pro- 

s vided for indicating operation timing of keys 1 5A to 1 5E. 
respectively, and the turntable track 67 is provided for 
indicating operation timing o1 the slide disk 23. 
[0077] In the key tracks 66A to 66E, there are dis- 
played index marks 68... 63 corresponding to the keys 

10 1 5A to 1 5E, and in the turntable track 67 are displayed 
an index mark" 69 corresponding to the slide disk 23. 
These marks 68, 69 are displayed so as to move down- 
ward abng the key tracks 66A to 66E or the turntable 
track 69 in accordance with the progress of the play of 

fs the music as indicated by an arrow V (refer to imaginary 
lines illustrated in the track 66B). 
[0078] When each of the marks 68, 69 reaches to a 
performance operation position PP defined at the lower 
end of the tracks 66 A to 66E and 67, the operation timing 

20 of each of the keys 15A to 15E and the slide disk 23 
associated with each track comes. At the lower ends of 
the tracks 66A to 66E and 67, there are displayed key 
type icons 70 A to 70E. which represent the keys 1 5 A to 
15E respectively, and turntable type icon 71 represent- 

25 in g the slide disk 23 so as to be adjacent to the perform- 
ance operation position PP. 

[0079] In FIG . 1 0. the mark 68 displayed in the left end 
track 66A has just reached to the performance operation 
position PP. so that the player is indicated to operate the 

30 key 15A from this moment until the mark 68 will disap- 
pear below the track 66A. Each of the lengths LI and 
12 of the marks 68 and 69 is changed in accordance 
with a length of an operation continuation time of the key 
15 or the slide disk 23. in other words a time period dur- 

35 Ing which the player must continuously operate the key 
15 or the slide disk 23, to thereby indicate the player to 
the operation continuation time as well as the start time 
of the performance operation. 

[0080] The above-mentioned display of the marks 68 
40 and 69 may be carried out, for example by the steps of: 
setting indicator display range which corresponds to the 
length of the tracks 66A to 66E and 67 on the lime chart 
of FIG. 7; moving the indicator display range toward the 
right side in FIG. 7; and repeating renewal of the display 
45 of the indicator 65 with considering a relationship be- 
tween the time chart in FIG. 7 and the display of the 
indicator 65 such that the left and right ends of the Indi- 
cator display range corresponds to the lower and upper 
end of the tracks 66A to 66E and 67, respectively, and 
so the rectangular portions in the time chart correspond to 
marks 68 and 69. 

[0081] In the present invention, the indication of the 
operation continuation time depending on the length of 
the mark 68 or 69 may be omitted; namely, each mark 
ss may be displayed with a fixed length to thereby indicate 
only the operation timing. Also, the indication of the in- 
dicator 65 may change in such a manner that the length 
of each index mark represents a time period during 
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which the player must hit the key 15 repeatedly. 
[0082] In the above-mentioned game machine 1, 
when acceptable coins of predetermined numbers are 
inserted into the coin insertion slot 11, the coin control 
device 35 issues a game start signal to the CPU 50, and 
the CPU 50 starts a predetermined game process in re- 
sponse to the signal. If the amount of the Inserted coins 
are enough for two players, a selection image which 
prompts the player to select either one of the single play- 
er mode or two players mode is displayed on the screen 
of the monitor 6, and the CPU 50 determines which one 
is selected in accordance with a selection operation of 
the player. The selection operation may be done by us- 
ing the supplement input device 30. The single player 
mode is a mode in which the game is played with using 
only one combination of the indicator 65 and the oper- 
ating section 12: and the two players mode is a mode 
in'which ihe game is played with using two combinations 
ot the indicator 65 and the operating section 12. Here- 
in<if icr inc single player mode will be represented as 1 P 
mode and the two players mode will be represented as 
2P mode 

[0083] In the game machine 1^ the entire game is di> 
vided into c: plurality of stages and the game play is ad- 
vanced stepwise with one stage being as a unit. FIG. 11 
shows one example of a combination of the stages. In 
this example, the game is advanced stepwise in six 
steps, that is, a training stage, one of stages A, B and 
C. a scratch stage, one of stages D and E. and one of 
stages F. G and H. Each stage features music, the genre 
of which is different from that of the other stage. For ex- 
ample, the stage ATeatures TECHNO music, and the 
stage B features EURO BEAT music. The scratch stage 
is a special stage in which only the turntable input unit 
1 4 is used for the performance operation. The combina- 
tion of the stages may be changed. For example, the 
training stage may be omitted by a cancel operation. 
[0084] FIG. 12 is a flow chart showing a procedure for 
one stage executed by the CPU 50. In this procedure, 
at least pari of the music data and the performance data, 
each of which corresponds to the present stage, are 
loaded from the storage device 56 to the RAM 54 {step 
SI ), and the contents of the stage are introduced to the 
player on the basis of the loaded data (step S2). For 
example, the genre of the music and the title thereof are 
displayed on the screen of the monitor 6, and a charac- 
teristic phrase of the music to be played in the current 
stage is played through the loud speakers 8A to BC to 
thereby allow the player to understand the contents of 
the stage. 

[0085] After introducing the stage, a predetermined 
start sign is given to the player through an image or 
sounds, and then the CPU 50 requests the sound 
processing unit 52 to start the play of the musical com- 
position on the basis of the music data currently stored 
in the RAM 54 or the storage device 56 (step S3). As a 
result, the play of the predetermined music is started. 
After starting the play, positions of the index marks 68 



and 69 in the indicator 65 are revised on the basis of a 
current play position of the music (step S4). This revision 
is cyclically repeated to move the marks 68 and 69 
downward in the indicator 65 in accordance with the 

5 progress of the play of the music. 

[0086] Next, the CPU 50 determines whether the op- 
eration timing of any one of the keys 15 and the slide 
disk 23 comes or not on the basis of the current play 
position of the music (refer to FIG. 7) and the perform- 

10 ance data (step S5). and gives the player an indication 
of the operation timing, it the operation timing comes 
(step S5). The indication is carried out by changing the 
color of the mark 68 or 69 which has reached to the per- 
formance operation position PP in the indicator 65. If the 

IS operation timing of any one of the keys 15A to 15E 
comes, the indicating lamp 1 7 of the key 1 5 to be oper- 
ated is turned on or blinked to show the player which 
key 1 5 should be operated. 

[0087] After the timing indication, the CPU 50 judges 

20 whether any one of the keys 15A to 15E, the slide disk 
23 and the push button switches 31 A to 31 C is operated 
or not (step S7). 11 judged that the operation is per- 
formed, the CPU 50 produces the performance effect 
corresponding to the operation (step SB). The periorm- 

2S ance effect may be producing a sound effect through 
the loud speakers 8A to 8C and blinking the illumination 
lamps 7A and 78 in association with the operation. The 
sound effect corresponding to each of the keys 15Ato 
15E and the push button switches 31 A to 31 C is deter- 

30 mined as illustrated in FIG. 8, and the sound effect cor- 
responding to the operation of the slide disk 23 is the 
above-mentioned scratch sound effect. 
[0088] After producing the performance effect, the 
CPU 50 detects difference between the actual operation 

35 performed by the player and the operation defined by 
the performance data, especially with respect to the op^ 
eration start time and the operation continuation time, 
and calculates a degree of accordance therebetween 
with using predetermined formulas to thereby estimate 

40 the operation of the player (step 89). The formulas are 
defined to decrease the degree of the accordance as 
the difference in the operation start time or continuation 
time increasing. If the operated key 15 or the slide disk 
23 is different from the operation member designated 
by the Indicator 65 to be operated, the degree of the 
accordance is not calculated, or the degree is calculated 
as a negative value. 

[0089] If it is judged at the step 85 that the operation 
timing does not come, the CPU 50 omits the above- 

50 mentioned indication of the operation timing at the step 
S6, and judges whether any one of the keys 1 5A to i 5E, 
the slide disk 23 and the push button switches 31 A to 
31 C is operated or not (step SI 0). If judged that the op- 
eration is performed, the CPU 50 produces the perform- 

55 ance effect corresponding to the operation (step S11). 
At this time, the performance effect may also be produc- 
ing a sound effect through the loud speakers 8A to BC, 
and blinking the illumination lamps 7A and 7B in asso- 



10 



BNSOOCID: <EP 09031 SSA2_I_> 



19 



EP 0 903 169 A2 



20 



ciation with the operation. 

[0090] The sound eftect produced at the step S11 is 
based on an adiib operation rather than an operation 
corresponding to the indication of the indicator 65. 
Therefore, it is not appropriate to estimate such an adIib 
operation on the basis of the degree of the accordance 
applied at the step S9. Accordingly, an adIib eftect value 
is calculated at the step S12 to estimate the adIib oper- 
ation by using formulas different from the formulas used 
at the step S9. The formulas used at the step S12 are 
adjusted to make a score higher as the adIib operation 
being judged asTnore timely and appropriate in view of 
current states of the music and the performance thereto. 
If the game is in the 2P mode, the degree of the accord- 
ance and the adIib effect value are calculated separately 
for each operation section 12. The calculation of the 
adIib effect value at the step SI 2 may be omitted; name- 
ly, the process may jump to the step S 1 6 after producing 
the performance effect at the step S11. 
[0091] After the calculation at the step S9 or SI 2. the 
CPU 50 calculates an amount of the groove gauge 61, 
ihat is, the length of the bar 61b and scores to be dis- 
played in the score frames 62A and 62B on the basis of 
the result of the above-mentioned calculation (step 
S13). The amount of the gauge is calculated so as to 
change in accordance with the superiority of the per- 
formance operation performed by the payer. For exam- 
ple, if the degree of the accordance or the adIib effect 
value exceeds to a p'-edetermined reference level, the 
gauge amount increases in accordance with a margin 
from the reference level, while the gauge amount de- 
creases in accordance with the margin if the degree of 
the value is under the reference level. Even if the 2P 
mode, the gauge bar 61 b displayed in the groove gauge 
61 is single, so that the gauge amount is calculated as 
a single value on the basis of each calculated result of 
the degree of the accordance and the adIib effect value 
for each operating section 1 2. On the other hand, the 
scores displayed In the score frames 62 A and 62B are 
calculated separately for each operating section 12 by 
aggregating the degrees of the amount and the adIib ef- 
fect values separately for each operating section 12. 
Therefore. If the two players simultaneously play the 
game, it is possible for the players to compete with each 
other for the high score. 

[0092] After the calculation of the gauge amount and 
the scores, the CPU 50 revises display states of the 
groove gauge 61 and the score frames 62A and 62B in 
cooperation with the image processing unit 51 , and then 
produces a reaction effect on the basis of the degree of 
the association or the adlib effect values calculated at 
the step 89 or 812. The reaction effect is'aimed to give 
the player feeling of arranging the music as a DJ (Disc 
Jockey) in a discotheque or the tike. Therefore, if the 
degree of the association or the adlib eftect value is a 
high level, cheering sounds of the audience may be pro- 
duced as the reaction effect, while booing sounds there- 
of may be produced if in the case of a low level. The 



illumination lamps may be used to enhance the reaction 
effect. 

[0093] After producing the reaction effect at the step 
SI 5 or judging at the step S7 or S10 that the operation 

5 is not performed, the CPU 50 judges whether the play 
of the music finishes or not (step 816). and if the play 
does not finish, the process returns to the step 84. If the 
play of the music finishes, the CPU 50 judges whether 
or not the player clears the stage in comparison with a 

10 predetermined condition (step 821). For example, the 
CPU 50 judges whether the stage is cleared or not in 
association with a judgement as to whether or not the 
amount of the groove gauge 61 at the end of the stage 
exceeds a predetermined level. 

?5 [0094] If it is judged that the stage is cleared, the CPU 
50 displays on the screen of the monitor 6 an image in- 
forming the player that the stage is cleared, and also 
produces a predetermined reaction effect (step S22). 
For example, great cheering sounds of audiences are 

20 produces as the reaction. At the next step S23, the CPU 
50 allows the player to advance to the next stage, and 
then finishes the process for the current stage. On the 
other hand, if it is judged at the step S21 that the stage 
is not cleared, the CPU 50 displays an image represent- 

^5 ing that the game is over and then finishes the process 
for the current stage. 

[0095] Next, another embodiment of the present in- 
vention will be explained with reference to FIGS. 13 to 
19. In this embodiment, the procedure during the game 
30 is changed from that of the above-mentioned embodi- 
ment of FIGS. 1 to 12. so that the following description 
will mainly be concerned with the difference against the 
above-mentioned embodiment. 

[0096] In this embodiment, a plurality of musical com- 
35 positions as the BGM to be used in the game are pre- 
pared similarly in the case of the above-mentioned em- 
bodiment. A data set illustrated in FIG. 1 3A is prepared 
for each musical composition and is stored in the auxil- 
iary storage device 56. The data set for the musical com- 
40 position X includes wave form data, wave form table da- 
ta, and performance data. 

[0097] As shown in FIG. 13B. the wave form data in- 
cludes BGM data and sound effect data. The BGM data 
contains data defining wave form for reproducing the 

45 musical composition X, and the sound effect data.con- 
tains data defining wave form of sound to be produced 
in response to operations to the keys 1 5 and the slide 
disk of the turntable input device 1 4. These data are pre- 
pared and stored, for example, as PCM or ADPCM data. 

50 The reason why the sound effect data is included in the 
data set for each musical composition is to produce 
sound effects appropriately for each genre of the BGM. 
[0098] As shown in FIG. 1 3C, the wave form table da- 
ta includes data tables for designating an address of the 

55 wave form data, a size of the wave form data, a pan pot 
(panning potentio meter), a port number and the like. 
The tables related to the address and the size contains 
information necessary for picking up the desirable BGM 



11 



ENSDOCID- <EP 0903169A2_I_> 



21 



EP 0 903 169 A2 



22 



data and the sound effect data from the above-men- 
tioned wave form data. The table for the pan pot con- 
tains information necessary for designating which chan- 
nel, that is, the left or right channel of the loud speakers 
8A to 8C must be used to produce the BGM sound or s 
the sound effect. Note that both channels can simulta- 
neously be used, if necessary. The table of the port 
number contains information necessary for designating 
the number of the port through which the BGM data and 
the sound effect data are issued. Namely, in this embod- 
iment, the sound processing unit 52 comprises a plural- 
ity of channels. '^for example 8 channels, to produce 
sounds, and one of the channels is selected, as a chan- 
nel through which the wave form data is reproduced, in 
accordance with the designation of the port number. The 
information for designating the port number is included 
in the table of the port number. 

[0099] As shown in FIG. 14, the performance data 
contains operation timing data, automatic play timing 
data, wave form number designation data, and tempo 
data. The operation timing data and the automatic play 
liming data are prepared as two sets, one of which is for 
an easy mode and the other of which is for a normal 
mode. The detail of the difference between both modes 
will be explained later. 

[0100] The operation timing data is data in which op- 
eration timing of the keys 1 5 and the slide disk 23 with 
respect to the musical composition X are designated in 
association with times which will be passed from a start 
of the musical composition X. In other words, the oper- 
ation timing data defines one of the operatbn members, 
i.e.. the keys 15 and the slide disk 23; which is to be 
operated at a specific time during the game. Therefore, 
the operation timing data corresponds to the data which 
is prepared by encoding the time chart illustrated in FIG. 
7 in association with the time passed from the start of 
the music. As is explained in FIG. 7, the operation timing 
data is prepared separately for each of the keys A to E 
and the turntable. The operation timing data provides 
bases of the display of the indicator 65 and of the judge- 
ment on the operations of the keys 15 and the slide disk 
23. Since the musical composition X comprises a plu- 
rality of phrases, information corresponding to times at 
which the phrases are changed are included in the op- 
eration timing data. 

[0101] The automatic play timing data is provided for 
producing performance sound effects unless any of the 
keys 15 and the slide disk 23 is operated, and defines 
designation of the sound effect which is to be produced 
at the specific time in the game. During the game jalay, 
the CPU 50 issues commands to the sound processing 
unit 52 so as to produce the designated sound effect at 
the time designated by the automatic play timing data. 
The reason why the automatic play timing data is pro- 
vided will be explained later. 

[01 02] The wave form number designation data is da- 
ta for designating the sound effect to be produced in re- 
sponse to the operation of each of the keys 15 and the 



slide disk 23. The relationship between the operation of 
each key 15 and the sound effect to be produced in re- 
sponse to the operation may be fixed through the entire 
play of the musical composition X. or be changed every 
appropriate period, such as phrase shown in FIG. 8. In 
case that the sound effect is changed in the middle of 
playing the musical composition X, information for dis- 
tinguish the relationship between the key 15 and the 
sound effect is recorded in the data in association with 
the time passed from the start of the music. The sound 
effect corresponding to the operation of the slide disk 
23 may be the scratch sound effect or be another sound 
effect. 

[01 03] The tempo data is data for defining a tempo of 
the musical composition X. In case that the tempo is 
changed in the middle of playing the musical composi- 
tion X, information for distinguish the tempo is recorded 
in the data In association with times passed from the 
start of the music. The game machine 1 controls the dis- 
play range of the indicator 65 with reference to the tem- 
po data. 

[0104] FIG. 15 shows a relationship between a read 
range of the operation timing data and a display range 
of the indicator 65, During the game play, the RAM 54 
(refer to FIG. 6) provides a pre-load buffer area for the 
operation timing data, and a part of the operation timing 
data which corresponds to a time period from the current 
time tx to the time ty is loaded into the pre-load buffer 
area. Note that, the current time tx corresponds to a time 
which has currently passed from the start of the play of 
the music. Further, a part of the data which corresponds 
to a time period form the current time tx to the time tn 
(>ty) is loaded from the pre-toad buffer area irito a dis- 
play buffer area in the RAM 54. The time period between 
the times tx and tn corresponds to two measures of the 
musical composition X, and the length of time thereof 
changes in accordance with the tempo of the play of the 
musical composition X. Accordingly, the CPU 50 deter- 
mines the time tn, which is late from the current "time tx 
by two measures, with reference to the tempo data, and 
then loads the operation timing data between the times 
tx and tn, as the data necessary for displaying the indi- 
cator 65, into the display buffer area. After this, the CPU 
50 performs calculations necessary for deitermining an 
arrangement of the index marks 68 and 69 in the indi- 
cator 65 on the basis of the operation timing data loaded 
in the display buffer area, and then produces image data 
for displaying the indicator 65 on the basis of the result 
of the calculations. The image processing unit 51 revis- 
es the image of the indicator 65 on the basis of the. pro- 
duced image data to thereby display the indicator 65 ap- 
propriate for the current time tx. The time ty may also 
be changed in accordance with the tempo of the musical 
composition X. The data loaded into the display buffer 
area is not limited to that corresponding to the two meas- 
ures. 

[01 05] FIGS. 1 6 and 1 7 are flow charts showing a pro- 
cedure for one stage executed by the CPU 50. In this 
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procedure, first of all, a mode select step in which the 
player is requested to select one of the easy mode and 
the norma! mode is executed in an interactive manner 
through the monitor 6 (step S51). The easy mode is a 
mode in which the game is carried out on the basis of 5 
the operation timing data and the automatic play timing 
data for the easy mode (refer to FIG. 1 4). and the normal 
mode is a mode in which the game is carried out on the 
basis of the operation timing data and the automatic play 
timing data for the normal mode. In the easy mode, dif- 
ficulty of the operation indicated through the indicator 
65 is easier than'^hat in the normal mode. For example, 
if the display of the indicator 65 at the specific time in 
the normal mode is set as Illustrated In the left side of 
FIG. 18, some of the index marks 63' are omitted at the 
same time In the easy mode as illustrated by imaginary 
lines in the right side of FIG. 18. As a result, the total 
number of the index marks displayed in the easy mode 
through the entire play of the music composition is less 
than that in the normal mode. Therefore, the player can 
operate the keys 15 and the slide disk 23 with compo- 
'sure in comparison with the normal mode. FIG. 18 
shows the arrangement of the marks 63 with respect on- 
ly to three rows of the tracks, however, the omission of 
the marks may be performed in all of the tracks 66 A to 
66E and 67, or only in a part of the rows of the tracks. 
[0106] Incase that the display of the marks 68' Is omit- 
ted in the easy mode, the player need not perform the 
operation corresponding to the omitted mark 68'. so that 
the performance effect to be mixed with the BGM is not 
produced. Therefore, the performance of the music in 
the easy mode maybe monotonous in comparison with 
that in the normal mode. In this case, there is a possi- 
bility that the interest of the game reduces. In order to 
avoid this situation, the automatic play timing data for 
the easy mode features commands to produce automat- 
ically the sound effect which corresponds to the omitted 
marks 68' at the timing when the mark 68' would reach 
to the performance operation position PP (refer to FIG. 
TO) if the display of the mark 63' were not omitted. Thus, 
in case that the automatic play timing data for each of 
the normal mode and the easy mode are compared with 
each other with respect to the same musical composi- 
tion X. the number of commands to produce the sound 
•effect issued on the basis of the data for the easy mode 
Is greater than that tor the normal mode. The automatic 
play timing data for the normal mode is not essential for 
the game. Therefore, it is possible to omit Ihe automatic 
play timing data for the normal mode, and every sound 
effect with respect to the composition X may be pro- 
duced only In response to the operations of the keys 1 5 
and the slide disk 23. 

[0107] Afterselectlngthe mode at the step S51 of FIG. 
16, the CPU 50 sequentially loads the wave form data 
and the wave form table data associated with the music 
assigned to the current stage (steps S52, S53). These 
data are common to both of the easy mode and the nor- 
ma! mode. Next at the step S53, the CPU 50 judges 



whether the easy mode Is selected or not. If the normal 
mode is selected, the CPU 50 loads the operation timing 
data and the automatic play timing data for the normal 
mode (step S 55). On the contrary, If the easy mode is 
selected, the CPU 50 loads the operation timing data 
and the automatic play timing data for the easy mode 
(step S 56). 

[0108] After loading the data at the step S55 or S55, 
the CPU 50 introduces the contents of the stage to the 
player (step S59), and then starts the play of the music 
(step S60). These steps are similar to the above-men- 
tioned step S2 or S3 in FIG. 12. Simultaneously with the 
start of the music, the CPU 50 starts clocking to watch 
the current time tx (FIG. 15), that is, the time currently 
passed from the start of the music play. Next at the step 
861. the CPU 50 obtains the data for the indicator. 
Namely the operation timing data from the current time 
tx to the time ty Is loaded into the pre-read buffer area 
in FIG. 1 5, and then the data from the current time tx to 
the time In which corresponds to two measures of the 
music is loaded into the display buffer area. 
[0109] Next at the step S 62. the CPU 50 judges 
whether a random mode is currently selected or not. If 
the random mode is selected, the CPU 50 changes the 
relationship between the operation timing data loaded 
into the display buffer area and the key tracks 66A to 
66E for changing the display of the marks 68 in the in- 
dicator 65 in such a manner that the arrangement of the 
marks 68 is reversed in the lateral direction with the 
center track 66C being as an axis in comparison with 
the arrangement in a non-random mode as illustrated in 
FIG. 19 (step 863). After this, the procedure proceeds 
to the step 864. Note that. FIG. 19 shows only three 
rows of the tracks 66B. 66C and 66D. however, the 
marks 68 in the left and right end tracks 66A and 66E 
are exchanged with each other. The relationship be- 
tween each of the tracks 66A to 66E and the marks 68 
in the. random mode is not limited to the embodiment in 
which the arrangement of the marks 68 is reversed in 
the lateral direction against the non-randonn mode. For 
example, the each marks 68 may be deviated by one 
row In the lateral direction, or exchanged between any 
two tracks, and various changes with respect to the ar- 
rangement of the marks 68 may be applied in the ran- 
dom mode. 

[0110] The reason why the random mode is prepared 
is as follows. In the game machine 1 , the player will learn 
the sequence of the operation of the keys 15 through 
repeating the play of the same music, and will be able 
to play the appropriate set of operations without check- 
ing the display In the indicator 65. In this case, there is 
a possibility that the difficulty of the game relatively re- 
duces and the player loses the interest in the game. 
However in the game machine 1 of this embodiment, 
since the arrangement of the marks 68 is reversed in 
the lateral direction in the random mode, it Is possible 
to throw the player into confusion such that the indicator 
65 indicates the operation of the key 1 5E when the play- 



75 



20 



2S 



30 



35 



40 



45 



50 



13 



BNSDOCJD: -cEP 09031 59A2.I_> 



25 



EP 0 903 169 A2 



26 



er expects to operate the key 15A In accordance with 

his memory. Therefore, it is possible to prevent the play- 
er from being skilled in the operation and to prevent the. 
decrease of the difficulty of the game^ thereby keeping 
the interest of the player in the game for a long time. The 5 
random mode may be selectable by the player, or the 
game machine 1 automatically select the random mode 
when a predetermined condition is satisfied- For exam- 
ple, if the player gets a result which exceeds the prede- 
termined level in the past stages, the game machine 1 fo 
will automatically select the random nnode for the next 
stage. The game machine 1 may comprise a clock cir- 
cuit and select the random mode in the specific time 
zone in a day. The judgement as to whether or not the 
game is currently in the random mode may be carried '5 
out, for example, by using a flag and distinguishing the 
value thereof. 

[011 1] On the other hand, if it is judged at the step S62 
that the game is not in the random mode, the process 
proceeds lo the step S64 with omitting the step S63. At 20 
jthe step S64, the CPU 50 revises the positions of the 
marks 63 and 69 in the indicator 65 on the basis of the 
data loaded into the display buffer area. The marks 88 
and 69 can be moved downward in the indicator 65 in 
accordance with the progress of the play of the music 2S 
by cyclically repeating the revision of the display of the 
marks. After the step S64, the process proceeds to the 
step S65 in the FIG. 17. 

[0112] At the step S65, the CPU 50 judges whether 
the operation timing of each of the keys 1 5 and the slide 30 
disk 23 comes or not on the basis of the current time 
and the operation timing data. At this step, if the current 
time is in a time range which is set so as to include op- 
eration timing designated by the operation timing data 
and to have a predetermined width, it is possible to con- 35 
sider the current time as the operation liming. If it is 
judged that the operation timing comes, the CPU 50 
gives the player the indication of the operation timing 
similarly at the step SB in FIG. 6 (step S67). After the 
indication of the operation timing, the CPU 50 judges ^0 
whether any one of the keys 1 5A to 1 5E, the slide disk 
23 and the push button switches 31 A to 31 CIs operated 
or not in the above-mentipned time range, lf .it is judged 
that the operation is performed, the CPU 50 produces 
the performance effect corresponding to the operation 
(step S69). The perfomriance effect at this step may be 
producing sound effect through the loud speakers 8A to 
8C, and blinking the illumination lamps 7A and 7B in as- 
sociation with the operation performed by the player. 
The relationship between the operation of each opera- -^o 
tion member, that is. the keys 15A to 15E and the push 
button switches 31 A to 31 C. and the sound effect is set 
as illustrated in FIG. 8. If in the random mode, the rela- 
tionship between each key 15 and the sound effect is 
changed similarly to the display arrangement of the in- 55 
dicator 65. For example, if the key 15E is operated in 
the random mode, the CPU 50 considers the operation 
to be an operation of the key 15A and produces the 



sound effect assigned to the key A in FIG. 8. 
[0113] After producing the performance effect, the 
CPU 50 calculates the degree of the accordance be- 
tween the operation of the player and the operation tim- 
ing defined by the operation timing data similarly at the 
step S9 in FIG. 12 (step S70). At this step, if the game 
is in the random mode, the relationship between each 
of the keys A to E illustrated in FIG. 7 and each of the 
keys 15A to 15E is changed similarly to the display ar- 
rangement of the indicator 65. For example, if the key 
15E is operated in the random mode, the CPU 50 con- 
siders the operation to be an operation of the key 1 5A 
and compares the operated time with the operation tim- 
ing with respect to the key A Illustrated in FIG. 7. 
[0114] If it is judged at the step S65 that the operation 
timing does not come, the CPU 50 omits the above- 
mentioned indication of the operation timing, and judges 
whether any one of the keys ISA to 15E. the slide disk 
23 and the push button switches 31 A to 31 C is operated 
or not (step S74). If il is judged that the operation is per- 
formed, the CPU 50 produces the performance effect 
corresponding to the operation (step S75). At this time, 
the performance effect may also be producing sound ef- 
fect through the loud speakers 8A to 8C, and blinking 
the illumination lamps 7A and 7B performed in associ- 
ation with the operation of the player. After this, the CPU 
50 calculates the adiib effect value similarly at the step 
S12of FIG. 12. 

[0115] After the calculation at the step S70 or S76, the 
CPU 50 calculates the amount of the groove gauge 61 , 
that is. the length of the bar 61b and scores to be dis- 
played in the score frames 62A and 62B on the basis of 
the result of the above-mentioned calculation(step S77). 
This step is similar to the step SI 2 in FIG. 13. After the 
calculation, the CPU 50 revises display states of the 
groove gauge 61 and the score frames 62A and 62B on 
the basis of the calculated result (step S78), and then 
produces the reaction effect on the basis of the degree 
of the association or the adIib effect value calculated at 
the step S70 or S76 (step S79). This step is similar to 
the step S15 in FIG. 15. After producing the reaction ef- 
fect, or judged at the step S68 or S74 that the operation 
is not performed, the CPU 50 judges whether the play 
of the music finishes or not (step S80), and if the play 
does not finish, the process returns to the step S61 in 
FIG 16. If the play of the music finishes at the step S80. 
the CPU 50 judges whether the player clears the stage 
or not similarly at the step S21' in FIG. 12 (step S81). If 
it is judged that the stage is cleared, the CPU 50 displays 
the image informing the player that the stage is cleared 
as in the case at the step S22 in FIG. 1 2, and also pro- 
duces the predetermined reaction effect (step S82). 
[0116] At the next step S83, the CPU 50 allows the 
player to advance to the next stage, and then finishes 
the process for the current stage. On the other hand, if 
it is judged at the step S81 that the stage is not cleared, 
the CPU 50 displays an image representing that the 
game is over (step S84). and then finishes the process 
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for the current stage. In this case, since the advance to 
the next stage is not allowed, the game is finished. 
[0117] The present invenfion is not limited to the 
above embodiments, and is carried out in various em- 
bodiments. For example, the turntable input unit 1 4 may 
be provided with a motor connected with the rotary shaft 
22 through a slide type clutch to rotate the slide disk 23 
during the game play, thereby imitating the rotation of 
the phonograph record disk. In this case, the manual 
operation of the slide disk 23 performed by the player 
causes the acceleration of the slide disk 23 whicfi can 
be detect on \h'e basis of the signals issued from the 
sensors 27A and 27B; therefore it is possible to produce 
and change the scratch sound effect in accordance with 
the acceleration of the slide disk 23. The game machine 
1 may be provided with a communication device, and 
the music data and the performance procedure data 
stored in the auxiliary storage device 56 may be rewrit- 
ten at any time from a remote location. This case allows 
the game machine 1 to always provide the player with 
up-to-date music. 
* [01 1 8] The display manner of the index marks 68 and 
69 in the indicator 65 may be changed besides the 
above-mentioned embodiments. FIG. 20 shows an ex- 
ample in which a hidden mode is prepared. In the hidden 
mode, after each of the marks 63 and 69 reaches to a 
position HD in the indicator 65, at least a part of the 
marks 68 and 69 is hidden as illustrated by imaginary 
lines and denoted by a reference numeral 68*. However, 
the estimation of the operation is determined in the 
same way as that in a non-hidden mode. Therefore, in 
order to clear the stage, the player has to operate keys 
15 with expecting the timing at which the hidden marks 
68' will reach the performance operation position PR Ac- 
cordingly, the difficulty of the game increases. Such con- 
trol in the hidden mode can be carried out by the steps 
of: deleting the designations of the operation timing, 
which is included in a range from the current time to a 
time corresponding to the position HD of the indicator 
65. with respect to the operation timing data loaded into 
the display buffer area, and comparing the actual oper- 
ation performed by the player with the operation timing 
data originally recorded in the performance data (refer 
to FIG. 1 3A) at each step for estimating the operation, 
•for example, at the step S70. S76 or S77 in FIG. 17. FIG. 
20 shows the marks 68 for the key tracks 15. however, 
the hidden mode may be applied to the marks 69 in the 
turntable track 67. 

[0119] FIG. 21 shows an embodiment in which the 
configurations of the operating sections 12A and 12B 
are modified. In this embodiment, the operating sections 
12A and 12B are arranged symmetrically in the lateral 
direction of the control panel 10. Namely, the turntable 
input unit 1 4 is disposed at the left side of the keyboard 
input device 1 3 in the left side operating sections 12A, 
while the unit 1 4 disposed at the right side of the unit 1 3 
In the right side operating section 128. According to this 
arrangement, in case that the single player inserts coins 



enough for two players and selects the 2P mode, the 
two sections 12A and 128 are arranged in the lateral 
direction near the hands of the player who stands at the 
center position of the game machine 1 in the lateral di- 

s rection thereof, so that the player can easily operate the 
operating members in both of the sections 1 2A and 1 28. 
In the embodiment of FIG. 21, the number of the keys 
15 in each section 12 is changed to seven. However, 
the present invention is not limited to the embodiment 

10 of providing each section 1 2 with the five or seven keys 
15, the number of the keys 15 may be changed various- 
ly. 

[0120] Besides the keys 15 and the slide disk 23, the 
operation input device may be provided with a slide type 

15 volume switch 80 illustrated in FIG. 22. The switch 80 
comprises a slit 81 extending in the vertical direction of 
FIG. 22 and a knob 82 slidably operable along the slit 
81 , and is capable of Issuing signals corresponding to 
the position of the knob 82. The slide type volume switch 

20 80 may use as an operation member for mixing the BGf^ 
or the sound effect added thereon with another special 
effect. The special effect may include a so-called sur- 
round effect, a change of the musical key, a cutting of a 
vocal part from the BGfv^. and an equalizing effect for 

25 high or low frequency band. The degree of addition of 
these effect may be changed in accordance with the po- 
sition of the knob 82. In one preferable example of using 
the slide type volume switch 80, the movable range of 
the knob 82 is divided into a plurality of sections, e.g. 

30 five sections, and the CPU 50 detects which section the 
knob 82 is located in. Then, the CPU 50 changes the 
degree of addition of the special effect in accordance 
with location of the knob 82. A plurality of the slide type 
volume switches 80 may be provided in the game ma- 

35 chine 1. 

[0121] FIGS. 23A and 23B show an embodiment in 
which the positions of the indicators 65A and 65B in the 
screen are changeable. In this embodiment, two modes 
are provided with respect to the display of the indicators 

40 65. In one mode, the indicators 65A and 65B are dis- 
played at the both ends of the screen in the lateral di- 
rection thereof (refer'to FIG. 23A) and in the other mode, 
the indicators 65A and 65B are displayed so as to be 
arranged side by side at the center of the screen '(refer 

45 to FIG. 23B). The latter mode has advantage that the 
player who stands at the center of the game machine 1 
can easily confirm both indicators 65 A and 65 B. and this 
arrangement may be most effective when the single 
player selects the 2P mode. In case that the coins 

50 enough for two players are inserted at the start of the 
process of FIG. 12 or FIG. 16, the process may further 
comprises a step for requesting the player to select one 
mode among the 1 P mode, a 2P mode for a single player 
and a 2P mode for two players, and the CPU 50 rnay 

55 control the process in such a manner that the mode of 
FIG. 23A is automatically selected in response to the 
selection of the IP mode or the 2P mode for the two 
players, while the mode of FIG. 238 is automatically se- 
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lected in response to the selection of the 2P mode for 
the single player. The mode of FIG. 23B and the ar- 
rangement of FIG. 21 may be associated with each oth- 
er to thereby provide the player with comfortable oper- 
ation environment. 

[01 22] in the above-mentioned embodiment = the data 
concerning the performance procedure, for example the 
performance data of FIG. 14, is prepared separately for 
each of the performance operating sections 12A and 
12B, and the two players operate the respective input 
units 13 and 14 to complete the performance of the BGM 
in cooperation with each other. However, the present in- 
vention is not limited to such a manner. The same data 
for the performance procedure may be used for both op- 
erating sections 12A and 12B. the indicators 65A and 
65B may indicate the same operation, and the opera- 
tions may be estimated separately for each of the sec- 
tions 12A and 12B to separately display the estimated 
scores in the respective score frames 62A and 52B. In 
this case, it is possible to provide the two players with 
J pleasure of competing with each other for the high score 
similarly in case of a so-called battle fighting game. Also, 
it is not necessary to define a plurality of the perform- 
ance procedures in the performance data for one piece 
of the BGM, and this fact causes the performance data 
to decrease its size. Therefore, if a capacity of the aux- 
iliary storage device 56 which can be used for the data 
is restricted: it is possible to increase the numbers of the 
music stored in the restricted capacity. Thus, it is possi- 
ble to increase, for example, the numbers of the stages 
shown in FIG. 11 . 

[01 23] In the above mentioned embod iment, the C PL) 
50 works as various devices necessary for processing 
the game by being combined with a particular software, 
however a part or all of the devices can be replaced with 
a logical circuit. 

Claims 

1 . A music action game machine comprising: 
a main body; 

an operation input device disposed on a front 
side of the main body so as to be adjacent to 
hands of a player facing the front side of the 
main body, the operation input device having a 
plurality of operation members; 
a storage device for storing data of a musical 
composition and data of a performance proce- 
dure associated with the musical composition; 
a music play device for playing the musical 
composition based on the data stored in the 
storage device; 

an operation instructing device for giving the 
player a visual instruction to operate the oper- 
ation members in accordance with progress of 
a play of the musical composition based on the 



data stored in the storage device; 
an effect producing device for producing a per- 
formance effect in response to a performance 
operation performed by the player to each of 

s the operation members; 

an estimation device for estimating the per- 
formance operation of the player based on a re- 
lationship between the performance procedure 
defined by the data stored in the storage device 

10 and the performance operation of the player; 

and 

an estimation informing device for informing the 
player of an estimation result determined by the 
estimation device. 

75 

2. A music action game machine according to claim 1, 
wherein the operation input device comprises a 
disk-shaped operation member as one of the oper- 
ation members, the disk-shaped operation member 

20 being operable so as to be turned about an axis 
thereof. 

3. A music action game machine according to claim 
2, wherein the effect producing device produces a 

25 scratch sound effect as the performance effect in 

response to a turning operation of the disk-shaped 
operation member, said scratch sound effect being 
similar to an actual scratch sound produced by ir- 
regularly turning a phonograph record disk with 

30 keeping contact between the phonograph record 

disk and a stylus of a phonograph player 

4. A music action game machine according to claim 
1 , wherein the operation instructing device compris- 

35 es: 

an indicator disposed on the front side of the 
nnain body and provided with at least one track 
extending in a predetermined direction; and 

40 a mark indicating device capable of indicating 

index marks, each of which is provided for in- 
dicating operation timing of each of the opera- 
tion members, in such a manner that each of 
the index marks moves along the track and then 

45 reaches to a fixed operation position defined in 

the track when the operation timing associated 
with each of the index marks comes. 

5. A music action game machine according to claim 
50 4, wherein the mark indicating device changes a 

length of each of the index marks in said predeter- 
mined direction in accordance with a length of an 
operation continuation time during which each of 
the operation members must be operated. 

55 ■ 

6. A music action game machine according to claim 4, 
wherein a plurality of tracks is provided as said at 
least one track, said tracks being arranged side by 
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side with each other so as to accord with an ar- 
rangement of the operation members. 

7. A music action game machine according to claim 1 , 
wherein an illumination device is provided on the 
front side of the main body, and the effect producing 
device controls an illumination of the illumination 
device in response to the performance operation of 
the player. 

8. A music action game machine according to claim 7, 
wherein a loDd^speaker is provided on the front side 
of the main body, and the illumination device com- 
prises a loud speaker illuminator surrounding an 
outer periphery of the loud speaker. 

9. A music action game machine according to claim 1 , 
■ wherein a relationship between each of the opera- 
tion members and the performance effect to be pro- 
duced in response to the operation thereto is 
changed in accordance with the progress of the play 
of the musical composition. 

1 0. A music action game machine according to claim 1 , 
wherein the estimation device estimates the per- 
formance operation each time the performance op- 
eration is actually performed during the play of the 
musical connposition, and the estimation informing 
device informs the estimation result each time the 
estimation device determines the estimation result. 

11. A music action game machine according to claim 1, 
wherein the estimation device estimates the per- 
formance operation with referring to a relationship 
between the performance procedure stored in the 
storage device and a length of an operation contin- 
uation time during which each of the operation 
members must be operated . • 

1 2. A music action game machine according to claim 1 . 
wherein: 

the main body has a plurality of operating sec- 
tions, each of which is provided with the oper- 
ation input device; 

the estimation device estimates the perform- 
ance operation separately for each of the oper- 
ating sections; and 

the estimation informing device informs the es- 
timation result separately for each of the oper- 
ating sections. 

1 3. A music action game machine according to claim 1 , 
wherein the estimation device calculates a score in 
accordance with superiority of the performance op- 
eration, and the estimation informing device informs 
the calculated score. 



14. A music action game machine according to claim 1 . 
wherein: 

the data storage device stores a plurality of da- 

s ta sets, each of which includes the data of the 

musical composition and the data of the per- 
formance procedure; and 
said game machine further comprises a stage 
progress management device tor controlling 

10 progress of a game in such a manner that when 

the estimation device gives a predetermined 
level of estimation with respect to the perform- 
ance operation in one stage in which the musi- 
cal playing device plays the musical composi- 

75 tion based on one of the data sets, the game is 

allowed to progress to a next stage in which the 
music play device plays the musical composi- 
tion and the instructing device instructs the per- 
formance operation based on another one of 

20 the data sets. 



15. A music action game machine according to claim 
14, wherein the effect producing device produces a 
reaction effect as one type of the performance effect 
2B when the game reaches to an end of said one stags, 
the reaction effect being changed in accordance 
with the estimation result at the end of said one 
stage. 

30 1 6. A music action game machine according to claim 1 . 

wherein the operation instructing device makes a 
decision as to whether or not operation timing of 
each of the operation members comes, and in- 
structs the performance operation to the player in a 

35 different visual manner in accordance with a result 
of said decision. 

17. A music action game machine according to claim 1 , 
wherein the estimation device makes a decision as 
40 to whether or not operation timing of each of the op- 
eration members comes, and estimates the per- 
formance operation when it is judged that the oper- 
ation timing comes. 

45 18. A music action game machine according to claim 1 , 
wherein the operation instructing device makes a 
decision as to whether or not operation timing of 
each of the operation members comes, and chang- 
es a standard, with which the performance opera- 

.50 tion is estimated, in accordance with a result of said 

decision. 

1 9. A music action game machine according to claim 1 , 
wherein the estimation device estimates the per- 
55 formance operation based on a difference between 

timing of the performance operation defined by the 
data of the performance procedure and timing at 
which the player actually performed the perform- 
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ance operation. 

20. A music action game machine according to claim 1 . 
wherein the effect producing device produces ef- 
fects different from each other in response to re- 
spective operations of the operation members, 
each of the effects corresponding to said perform- 
ance effect. 

21. A music action game machine according to claim 
10, wherein the effect producing device produces a 
reaction effect as one type of the performance effect 
each time the estimation device determines the es- 
timation result, the reaction effect being changed in 
accordance with the estimation result. 

22. A music action game machine according to claim 1 , 
wherein the effect producing device produces a pre- 
determined sound effect so as to remix sounds of 
the musical composition with the sound effect in ac- 

^ cordance with the performance operation. 

23. A music action game machine comprising: 

a main body; 

an operation input device disposed on a front 
side of the main body so as to be adjacent to 
hands of a player facing the front side of the 
main body, the operation input device having a 
plurality of operation members; 
a storage device for storing data of a perform- 
ance procedure associated with a predeter- 
mined musical composition; 
an operation instructing device lor giving the 
player a visual instruction to operate the oper- 
ation members based on the data of the per- 
formance procedure stored in the storage de- 
vice; 

an effect producing device for producing a per- 
fomnance effect in response to a performance 
operation of the player to each of the operation 
members; 

an estimation device for estimating the per- 
fomnance operation of the player based on a re- 
lationship between the performance procedure 

defined by the data stored in the storage device 
and the performance operation of the player; 
and 

an estimation informing device for informing the 
player of an estimation result determined by the 
estimation device. 

24. A music action game machine comprising: 

an operation input device having a plurality of 
the operation members and capable of issuing 
operation input signals different from each oth- 
er in accordance with each of operations to the 
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Operation members; 

a storage device for storing data of a musical 
composition, data of a performance procedure 
with respect to each of the operation members 
of the operation input device, and data of sound 
effects corresponding to each of the operation 
members; 

a music play device for playing the musical 
composition based on the data of the musical 
composition stored in the storage device; 
an performance proc'edure presenting device 
for presenting the player with the performance 
procedure In a visual manner in association 
with a play of the musical composition based 
on the data of the performance procedure 
stored in the storage device,; 
a sound effect producing device for producing 
the sound effects based on the operation input 
signals issued from the operation Input device 
and the data of the sound effects stored in the 
storage device; 

an estimation device for estimating operations 
of the player based on the operation input sig- 
nals issued from the operation input device and 
the data of the performance procedure stored 
in the storage device; and 
an estimation informing device for informing an 
estimation result determined by the estimation 
device. 

25. A music action game machine according to claim 1 , 
wherein: 

the storage device stores a data set including 
the data of the musical composition and a plu- 
. rality of operation data sections associated with 
the musical composition, each of the operation 
data sections corresponding to the data of the 
performance procedure; 
at least one of the operation data sections is 
prepared so as to make difficulty with respect 
to the performance procedure defined thereby 
easier than that defined by another one of the 
operation data sections; and 
the operation instructing device selects any one 
of the operation data sections and instructs the 
player to operate the operation members based 
on said selected one of the data sections. 



50 26. 



55 



A music action game machine according to claim 
25, wherein the performance procedure defined by 
said at least one of the operation data sections is 
substantially equal to a procedure in which a part of 
operations to the operation members is omitted in 
comparison with the performance procedure de- 
fined by said another one of the operation data sec- 
tions. 
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27. A music action game machine according to claim 
26, wherein: 

the storage device stores automatic play data 
for producing the performance effect corre- 
sponding to each of the operations which are 
omitted in comparison with the performance 
procedure defined by said another one of the 
operation data sections; and 
the game machine further comprises an auto- 
matic play device capable of producing the per- 
formanc"fe >etfect based on the automatic play 
data independently of the performance opera- 
tion of the player. 

28. A music action game machine according to claim 1 . 
I jrther comprising an operational relationship con- 
trol device for changing a relationship between op- 
cralions of the operation members defined by the 
data of the performance procedure and the opera- 
lofi membeis which are designated to be operated 
n rough the instruction of the operation instructing 
device with respect to the same musical composi- 
tion 

29. A music action game machine according to claim 1 , 
wherein the operation instructing device comprises: 

an indicator disposed on the front side of the 
main body, at lease one part of the indicator be- 
ing provided with a plurality of tracks which ex- 
tend in a predetermined direction and which 
correspond to the operation members, respec- 
tively; and 

a mark indicating device capable of indicating 
index marks, each of the index marks corre- 
sponding to each operation timing of the oper- 
ation members which will come in a certain pe- 
riod from a present to future in a game, and the 
index marks being disposed in the tracks so as 
to be arranged from a predetermined position 
toward one side of the predetermined direction 
in accordance with time order therebetween. 

30. A music action game machine according to claim 
29, wherein the mark Indicating device is capable 
of changing an indication manner of the index 
marks between a first mode and a second mode, 
the first mode being prepared to set a relationship 
between the index marks and the tracks equal to a 
relationship between the operation members and 
the operation timing defined by the data of the per- 
formance procedure, and a second mode being pre- 
pared to set the relationship between the index 
marks and the tracks in a different manner from that 
of the first mode. 

31. A music action game machine according to clalrri 



30. wherein the estimation device estimates the 
performance operation with interpreting that a rela- 
tionship between the operation timing of each of the 
operation members defined by the data of the per- 
s formance procedure and the performance opera- 

tion to each of the operation members is changed 
in accordance with the relationship between the in- 
dex marks and the tracks when in the second mode. 

10 32. A music action game machine according to claim 
29, wherein the mark indicating device is capable 
of selecting a third mode in which the index marks 
are hidden in a specific range which extends from 
the predetermined position in the tracks toward said 

^5 one side of the predetermined direction. 

33. A music action game machine according to claim 1 , 
wherein: 

20 the main body has a plurality of operating sec- 

tions, each of which is provided with the oper- 
ation input device; 

the operation instructing device is capable of 
instructing the same performance procedure to 

25 each of the operating sections with respect to 

the same musical composition; 
the estimation device estimates the perform- 
ance operation separately for each of the oper- 
ating sections; and 

30 the estimation informing device informs the es- 

timation result separately for each of the oper- 
. ating sections. 

34. A music action game according to claim 1 , wherein: 

35 

the main body is provided with a plurality of op- 
erating sections arranged in a lateral direction 
thereof, each of the operating section being 
provided with the operation input device; 
40 the front side of the main body is provided with 

a display device for displaying a game image; 
and 

the operation instructing device is capable of 
changing a display manner of the display de- 

45 vice between a first display mode and a second 

display mode, the first display mode being pre- 
pared to display images for Indicating timing of 
the performance operation on a screen of the 
display device with leaving a space between 

50 each of the images in the lateral direction in ac- 

cordance with an arrangement of the operating 
sections, and the second display rhode being 
prepared to display the images for indicating 
timing in such a manner that a space therebe- 

55 tween is less than that in the first display mode. 

35. A music action game machine according to claim 1 , 
wherein each of the data of the musical composition 
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and the data of the performance effect is stored in 
the storage device as PCM data. 

36. A performance operation instructing system, which 
instructs a player to operate at least one operation 
member at a predetermined timing in association 
with progress of a play of a predetermined musical 
composition, comprising: 

an indicator provided with at least one track ex- 
tending in a predetermined direction; and 
a mark Indicating device capable of indicating 
index marks, each of which is provided for in- 
dicating operation timing of the operation mem- 
ber, in such a manner that each of the index 
marks moves along the track and then reaches 
to a fixed operation position defined in the track 
when the operation timing associated with each 
of the index marks comes. 

/37. A performance operation instructing system ac- 
cording to claim 36, wherein the mark indicating de- 
vice changes a length of each of the index marks in 
said predetermined direction in accordance with a 
length of an operation continuation time during 
which the operation member must be operated. 

38. A performance operation instructing system ac- 
cording to claim 36, wherein a plurality of operation 
members is provided as said at least one operation 
member, and a plurality of tracks is provided as said 
at least one track, said tracks being arranged side 
by side with each other so as to accord with an ar- 
rangement of the operation members. 

39. A storage device readable by a computer which 
stores data defining a procedure for operating op- 
eration members provided in a game system in as- 
sociation with a predetermined music, and a pro- 
gram for instructing a player to operate the opera- 
tion members through a screen of a display device 
provided in the game system, said program being 
prepared for causing the computer to execute steps 
of: 

displaying an Image of an instruction on the 
screen of the display device to operate the op- 
eration members based on the data defining 
the procedure; 

producing a performance effect in response to 
an operation of the operation members per- 
fomned by the player; 

estimating the operation of the operation mem- 
bers based on a relationship between the data 
defining the procedure and the operation per- 
formed by the player; and 
informing a result of said estimating step to the 
player. 
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40. A Storage device readable by a computer which 
stores data defining a procedure for operating op- 
eration members provided in a game system in as- 
sociation with a predetermined music, data of 
sound effects to be produced in association with op- 
eration input signals issued from the operation 
members in response to operations thereof, and a 
program for instructing a player to operate the op- 
eration members through a screen of a display de- 
vice provided in the game system, said program be- 
ing prepared for causing the computer to execute 
steps of: 

displaying an image of an instruction on the 

screen of the display device to operate the op- 
eration members based on the data defining 
the procedure; 

producing at least one of the sound effects 
based on the operation input signals issued 
from the operation members and the data of the 
sound effects; 

estimating operations performed by the player 
based on the operation input signals issued 
from the operation members and the data de- 
fining the procedure; and 
informing a result of said estimating step to the 
player. 

41. A storage device readable by a computer which 
stores a program for giving a player an instruction 
to operate at least one operation member provided 
in a game system at a predetermined timing in as- 
sociation with progress of a play of a predetermined 
musical composition, said instruction being given 
through a screen of a display device provided in the 
game system, and said program being prepared for 
causing the computer to execute steps of: 

displaying an indicator on the screen of the dis- 
play device, said indicator being provided with 
at least one track extending in a predetermined 
direction; and 

indicating index marks, each of which is provid- 
ed for indicating operation timing of the opera- 
tion member, in such a manner that each of the 
index marks moves along the track and then 
reaches to a fixed operation position defined in 
the track when the operation timing associated 
with each of the index marks comes. 
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(57) The music action game machine comprises: a 
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for producing a performance effect in response to a per- 
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mating the performance operation of the,player based 
on a relationship between the performance procedure 
defined by the data stored in the storage device and the 
performance operation of the player; and an estimation 
informing device for informing the player of an estima- 
tion result determined by the estimation device. There- 
fore, the player can enjoy the simulation of the perform- 
ance of the music through the operation of the operation 
members. 
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(54) Program drive device tor computers 

(57) A program drive device for computers and 
game machines, to control a variety of game programs, 
aerobic programs or dance programs in response to 
physical movement of a user comprises a pad (2) pro- 
vided with a pluraliti' of rails (la, 1b, 1c, Id) thereon. A 
respective upstanding support column (3) movably en- 
gages each of the rails and Is movable along and may 
be fixed to the rail at an adjustable position. Upper and 



lower sensor units (4, 5) are movably installed on upper 
and lower portions of the support columns such that they 
are movable along the length thereof and may be fixed 
thereto at adjustable positions. The sensor units (4, 5) 
sense motion of the body of a user moving on the pad 
and output motion signals to a computer, thus allowing 
the computer to display motion of a character, corre- 
sponding to the motion of the user, on the monitor of the 
computer. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present Invention relates to a program 
drive device for computers and game machines, de- 
signed to run a variety of game programs, aerobic pro- 
grams or dance programs on personal computers, com- 
mercial computers, personal game machines, or com- 
mercial game m^achines, under the control of users' 
physical action, such as hand action and foot action, 
within a limited space, and, more particularly, to a pro- 
gram drive device for computers, having a plurality of 
sensor units movably installed in a plurality of support 
columns movably standing on a pad having a predeter- 
mined area, each of the sensor units consisting of a light 
emitting part and a light receiving pari so as to be acti- 
vated or inactivated by a motion of a user's body and 
outputtlng a motion signal to the input port of a computer, 
thus running a variety of game programs, aerobic pro- 
grams or dance programs on personal computers, com- 
mercial computers, personal game machines, or com- 
mercial game machines, under the control of users' 
physical action in place of a conventional keyboard op- 
eration, joystick operation or mouse operation. 

Description of the Prior Art 

[0002] As well known to those skilled in the art, a va- 
riety of game programs, aerobic programs or dance pro- 
grams for personal computers, commercial computers, 
personal game machines, or commercial game ma- 
chines have been typically performed and controlled by 
operating keyboards, joysticks, or mouses. 
[0003] However, such conventional game programs, 
aerobic programs or dance programs for computers and 
game machines force a user to operate a keyboard, a 
joystick or a mouse with his fingers while sitting in a chair 
and watching a monitor screen for a lengthy period of 
time without moving his body actively. Therefore, it is 
almost impossible to expect active physical exercise 
from use of such conventional programs. The conven- 
tional game programs, aerobic programs or dance pro- 
grams for computers and game machines may adverse- 
ly affect users' health when users use the programs for 
a lengthy period of time. 

[0004] In an effort to overcome such problems expe- 
rienced in the conventional game programs, aerobic 
programs or dance programs, somewhat active pro- 
grams, such as a variety of DDR (Dance-Dance Revo- 
lution) programs, have been proposed. In order to per- 
form a conventional DDR program, a user, standing on 
a control pad provided with differently oriented arrow 
switch sensors and laid on a flat support surface, con- 
tinuously, actively and specifically steps on the arrow 
switch sensors of the control pad designated by quickly 



varying images displayed on the monitor screen. How- 
ever, such conventional DDR programs only provide 
two-dimensional activity -in addition to jumping activity- 
performed by legs and feet within a limited area defined 

5 by the control pad. Therefore, the conventional DDR 
programs are problematic in that they cannot provide 
physical exercise or rhythmic movement of user's upper 
body, including arms and hands, even though they allow 
physical exercise and rhythmic movement of user's low- 

10 er body including the legs and feet. 

SUMMARY OF THE INVENTION 

[0005] Accordingly, the present invention has been 

15 made keeping in mind the above problems occurring in 
the prior art, and an object of the present Invention is to. 
provide a program drive device for computers, which 
has a plurality of sensor units movably installed in a plu- 
rality of support columns of a pad. and consisting of a 

20 light emitting part and a light receiving part so as to be 
activated or inactivated by a motion of a user's body, 
and outputting a motion signal to the input port of a com- 
puter, thus running a variety of game programs, aerobic 
programs or dance programs on personal computers, 

25 commercial computers, personal game machines, or 
commercial game machines, under the control of users' 
physical action in place of a conventional keyboard op- 
eration, joystick operation or mouse operation, and 
which provides physical exercise and rhythmic move- 

30 ment of user's body while exciting user's interest. 

[0006] Another object of the present invention is to 
provide a program drive device for computers, which is 
usable with a conventional DDR, thus running a pro- 
gram in response to a motion of hands, arms, feet and 

35 legs of a user. 

[0007] A further object of the present invention is to 
provide a program drive device for computers, which is 
simply and easily connected to the input port of a con- 
ventional computer, such as the keyboard terminal, joy- 

40 stick temninal or mouse terminal of a personal computer, 
commercial computer or game machine, without forcing 
a user to purchase a separate equipment. 
[0008] Still another object of the present inventlpn is 
to provide a program drive device for corriputers, which 

45 is designed to run a program of a computer or a game 
machine in response to a motion of a user's body without 
forcing the user to become skilled in computer opera- 
tion, thus allowing people to easily and simply use game 
programs of computers or game machines without be- 

50 ing afraid of complex operation procedures of the com- 
puters and game machines. 

[0009] In order to accomplish the above objects, an 
embodiment of the present invention provides a pro- 
gram drive device for running a game program in com- 
55 puters. comprising: a pad having a predetermined area 
and provided with a plurality of rails thereon; a support 
column movably engaging with each of the rails while 
standing upright on the rail, the support column being 
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movable along the rail as desired and fixed to the rail at 
an adjustable position; and two sensor units movably 
installed in each of the support columns of the. rails at 
upper and lower portions of the support column, thus 
being nnovable along each support column and fixed to 
the support column at adjustable positions, whereby the 
sensor units sense a motion of a user's body moving on 
the pad and output motion signals to a computer, thus 
allowing the computer to display a variable motion of a 
character, corresponding to the motion of the user's 
body, on the monitor of the computer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 0] The above and otherobjects, features and oth- 
er advantages of the present invention will be more 
clearly understood from the following detailed descrip- 
tion taken in conjunction with the accompanying draw- 
ings, in which: 

J Fig. 1 is a view, showing the operational theory of 
a program drive device for computers in accord- 
ance with the present invention; 
Fig. 2 is a plan view of the program drive device for 
computers of the present invention; 
Fig. 3 is a side view of the program drive device for 
computers of this invention, particularly showing an 
opposite directional movement of sensor units rel- 
ative to vertical support columns; and 
Fig. 4 is a perspective view of the program drive de- 
vice for computers of this invention, particulariy 
showing an assemblage of one support column on 
a control rail of the device, with an arrangement of 
two sensor units movably installed in the support 
column. 

DETAILED DESCRIPTION OF THE INVENTION 

[0011] Figs. 1 to 4 show the operational theory and 
construction of a program driye device for computers in 
accordance with the preferred embodiment of this 
present invention. As shown in the drawings, the pro- 
gram drive device of this invention comprises a rectan- 
gular pad 2 having a predetermined area and including 
a control rail 1 consisting of four diagonally positioned 
rails 1a, 1b, 1c and 1d. Four movable folding support 
columns 3, having a rectangular cross-section, are ver- 
tically installed at the four comers of the pad 2 such that 
the columns 3 are movable along the four rails la, 1b, 
1 c and 1 d. Upper and lower sensor units 4 and 5 are 
provided at the upper and lower position^ of each sup- 
port column 3 such that the sensor units 4 and 5 are 
vertically movable in opposite directions along each 
support columns 3 under the guidance of vertical slits 
as wilt be described in detail later herein. Each of the 
upper and lower sensor units 4 and 5 comprises a light 
receiving part 41 or 51 and a light emitting part 42 or 52. 
In such a case, the light receiving parts and light emitting 



parts of the upper and lower sensor units 4 and 5 are 
selected from a variety of photo sensors, such as infra- 
red sensors and laser sensors, and are positioned on 
the two inside walls 31 and 32 of each support column 
5 3, with the two inside walls 31 and 32 meeting each other 
at a right angle. In the present invention, the light receiv- 
ing parts and light emitting parts of the upper and lower 
sensor units 4 and 5 may be selected from a variety of 
transmissive or reflective photo sensors. The above 
10 sensor units 4 and 5 are connected to a signal input port 
of a computer 6, such as the keyboard terminal, joystick 
terminal or mouse terminal of a personal computer, a 
commercial computer, or a game machine, and so mo- 
tion signals from the sensor units 4 and 5 are applied to 
15 the computers during an operation of the program drive 
device. 

[0012] In the above program drive device, the control 
rail 1 , consisting of four diagonal rails 1a, lb, 1c and1d, 
has a longitudinal channel 11 formed along the rail 1 . A 
20 movable connector 14 engages with the channel 11 of 
each of the four diagonal rails la, lb, 1c and Id such 
that the movable connector 1 4 is movable along the lon- 
gitudinal channel 11. Each of the movable connectors 
14 comprises a roller 12 movably set in the channel 11 . 
25 A top boss 13 is formed at the top of the connector 14, 
and is projected upward from the channel 11 . Each of 
the four support columns 3, having a bottom boss 39 at 
its lower end, is hinged to the top boss 1 3 of an associ- 
ated movable piece 1 4 at the bottom boss 39 using a 
30 locking bolt 15. Therefore, the four support columns 3 
movably engage with the four rails 1 a, lb, 1c and 1 d of 
the control rail 1 while being movable along said rails 
and being foldable relative to the rails. 
[0013] The four support columns 3 have the same 
35 shape and construction. Each of the four columns 3 is 
hollowed to have an axial opening 35, with two upper 
guide slits 33 and 33' and two lower guide slits 34 and 
34' longitudinally formed on the two inside walls 31 and 
32 of the column 3. Two locking slits 37 and 37' are lon- 
40 gitudinally fonmed on one of the two outside walls 36 of 
each support column 3 ait upper and lower positions in 
the same manner as that described for the longitudinal 
guide slits. Two support blocks 43 and 53 are movably 
installed within the opening 35 of each support column 
45 3 at upper and lower positions corresponding to the up- 
per and lower guide slits. The upper and lower sensor 
units 4 and 5, each having a light receiving part 41 or 

51 and a light emitting part 42 or 52 selected from infra- 
red sensors or laser sensors, are mounted to the two 

so support blocks 43 and 53 movably Installed within the 
opening 35 of each support column 3. The position of 
the movable sensor units 4 and 5 inside each support 
column 3 is selectively fixed by locking bolts. 38 and 38'. 
[0014] The two light receiving parts 41 and 51 and two 

55 light emitting parts 42 and 52 of the upper and lower 
sensor units 4 and 5 Installed in each support column 3 
are positioned to face the two light emitting parts 42 and 

52 and two light receiving parts 41 and 51 of two neigh - 
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boring support columns 3. Therefore, the light emitting 
parts 42 and 52 of each support column 3 emit infrared 
rays or laser beams to the light receiving parts 41 and 
51 of one neighboring support column 3. while the light 
receiving parts 41 and 51 of each support column 3 re- 
ceive infrared rays or laser beams output from the light 
emitting parts 41 and 51 of the other neighboring sup- 
port column 3. When part of the body of a user, such as 
hands, arms, feet or legs, is positioned at or passes 
through the paths of infrared or laser beams during an 
active movement of the user standTng on the limited area 
of the pad 2, the beams are temporarily blocked. The 
infrared or laser beams from the light emitting parts 42 
and 52 of the four columns 3 are thus intermittently in- 
tercepted by the body of the user, and so the light re- 
ceiving parts 41 and 51 of the columns 3 are repeatedly 
and aliernaiely activated and Inactivated. Therefore, the 
signal units 4 and 5 of the four columns 3 output ON/ 
OFF signals lo the input port of the computer 6, such as 
the keyboatd terminal, joystick temninal or mouse termi- 
jna) of a personal computer, a commercial computer or 
a game machine. In response to the ON/OFF signals 
from the sensor units 4 and 5, the computer 6 perfomns 
the program in the same manner as that performed in 
accordance with input signals from a conventional key- 
board, joystick or mouse operated by a user. 
[001 5] When the pad 2 of the present invention is de- 
signed as a foot-operable pad in the same manner as 
th?t of a conventional DDR, a user can activate or inac- 
tivate the light receiving parts 41 and 51 of the sensor 
units 4 and 5 of the support columns 3 with parts of his 
body, such as hands, amis, feet and legs, while control- 
ling the pad by jumping activity performed by legs and 
feet within the limited area of the pad. In such a case, 
the user operates the program as if he moves in a virtual 
space, and so the program drive device of this invention 
can provide desired active physical exercise or active 
rhythmic movement of user's body including anns, 
hands, feet and legs. 

[0016] In the above-mentioned preferred embodi- 
ment the program drive device of this invention has four 
support columns 3 at the corners of the rectangular pad 
2, and so the device only allows a user to use the pro- 
gram while moving in four directions, that is, forward, 
backward leftward and rightward directions. However, It 
should be understood that the number of support col- 
umns 3, each having the upper and lower sensor units 
4 and 5, may be increased as desired. For example, 
eight support columns 3, each having the upper and low- 
er sensor units 4 and 5 at its upper and lower portions, 
may be vertically installed at the four comers and the 
middle positions of the four sides of the pad 2. In such 
a case, the device preferably allows a user to use the 
program while moving in eight directions. In addition, 
sixteen support columns 3, each having the upper and 
lower sensor units 4 and 5, may be vertically installed 
on the pad 2 at predetermined positions so as to allow 
a user to use the program while moving in sixteen direc- 



tions. Therefore, it is noted that the program drive device 
of this invention can allow a user to use the program 
while moving in four, eight or sixteen directions In ac- 
cordance with the number of support columns 3. 

5 [0017] In the present invention, it is possible to adjust 
the position of the support columns 3 on the control rail 
1 of the pad 2 as desired. In addition, the sensor units 
4 and 5 are movable along the guide slits 33, 33', 34 and 
34' of each support column 3 of the pad 2, and so the 

10 height of the sensor units 4 and 5 of the support columns 
3 may be adjustable as desired. Therefore, it is possible 
for users, regardless of height or physique, to effectively 
use the program drive device of this invention while ad- 
justing the size of the motion space of the device by 

15 changing the positions of the columns 3 and the sensor 
units 4 and 5. 

[0018] In the preferred embodiment, the control rail 1 
is installed on the rectangular pad 2, with four support 
columns 3 having two movable sensor units 4 and 5 and 

20 vertically positioned at the corners of the pad 2 such that 
the position of the columns 3 on the rail 1 is adjustable 
as desired. However, it should be understood that the 
support columns 3, having two movable sensor units 4 
and 5, may stand upright on a support surface in place 

25 of the pad 2 at desired positions, thus defining a desired 
motion space by the sensor units 4 and 5 of the columns 
3. Therefore, the program drive device of this invention 
can be easily installed on a support surface without be- 
ing limited in its installation area, and allows users to run 

30 a variety of game programs, aerobic programs or dance 
programs on personal computers, commercial comput- 
ers, personal game machines, or commercial game ma- 
chines, under the control of users* physical action, such 
as hand action, arm action, foot action and leg action, 

35 within a limited space. 

[001 9] As described above, the present invention pro- 
vides a program drive device for computers. This pro- 
gram drive device has a plurality of sensor units movably 
installed in a plurality of support columns of a pad. Each 

40 of the sensor units consists of a light emitting part and 
a light receiving part so as to be activated or inactivated 
by a motion of a user's body, and outputs a motion signal 
to the input port of a computer, thus running a vanety of 
game programs, aerobic programs or dance programs 

45 on personal computers, commercial computers, per- 
sonal game machines, or commercial game machines, 
under the control of users' physical action in place of a 
conventional keyboard operation, joystick operation or 
mouse operation. The program drive device of this in- 

50 vention provides physical exercise and rhythmic move- 
ment of user's body while exciting user's interest. In ad- 
dition, the program drive device of this invention is de- 
signed to run a game program of a computer or a game 
machine in response to a motion of a user's body without 

55 forcing the user to become skilled in computer opera- 
tion , thus allowing people to easily and simply use game 
programs of computers or game machines without be- 
ing afraid of complex operation procedures of the com- 
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puters and game machines. This program drive device 
is also usable with a conventional DDR. thus running a 
program in response to a motion of hands, arms, feet 
and legs of a user. Another advantage of this program 
drive device resides in that it Is simply and easily con- 
nected to the input port of a conventional computer, such 
as the keyboard terminal, joystick temiinal or mouse ter- 
minal of a personal computer commercial computer or 
game machine, without forcing a user to purchase a 
separate equipment. 

[0020] Although "a preferred embodiment of the 
present Inventioh has been described for illustrative pur- 
poses, those skilled in the art will appreciate that various 
modifications, additions and substitutions are possible, 
without departing from the scope and spirit of the inven- 
tion as disclosed in the accompanying claims. 



Claims 

;1 . A program drive device for controlling a program in 
a computer, comprising: 

a pad provided with a plurality of rails thereon; 
a support column movably engaging and up- 
standing from each of said rails, the support 
columns being movable along the rails as de- 
sired and fixabie thereto at an adjustable posi- 
tion; and 

sensor means installed on each of the support 
columns and being movable along the length 
thereof and fixabie thereto an adjustable posi- 
tion, 

whereby the sensor means senses motion of 
the body of a user moving on the pad and out- 
putts a motion signal to the computer, thus al- 
lowing the computer to display movement of a 
character, corresponding to the motion of the 
user's body, on a monitor of the computer. 

2. A program drive device as claimed in Claim 1. 
wherein the sensor means is connected to a signal 
input port, comprising a keyboard terminal, a joy- 
stick temiinal- or a mouse terminal of a personal 
computer, a commercial computer or a game ma- 
chine. 

3. A program drive device as claimed in Claim 1 or 2, 
wherein the sensor means comprises upper and 
lower sensor units movably installed at upper and 
lower portions of each support column, the upper 
and lower sensor units being movable along the 
support column and each consisting of a light emit- 
ting portion and a light receiving portion comprising 
a photo sensor capable of sensing motion of the us- 
er's body, the light emitting and light receiving por- 
tions being positioned on two mutually perpendicu- 
lar walls of the support column. 



4. A program drive device as claimed in any one of 
claims 1 to 3, wherein the sensor means comprises 
a transmissive photo sensor. 

5 5. A program drive device as claimed in any one of 
Claims 1 to 3, wherein said sensor means compris- 
es a reflective photo sensor. 

6. A program drive device as claimed in any one of 
10 claims 1 to 6, wherein each support column is fold- 
able relative to the pad and is thus movable be- 
tween a vertical and a horizontal position. 
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